-- Logs begin at Mon 2022-05-09 09:04:52 UTC, end at Mon 2022-05-09 10:43:20 UTC. -- May 09 09:38:20.243197 dv-cinder-841083-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 09:38:20.252026 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 09:38:20 2022] *** May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: nodename: dv-cinder-841083-1-iscsi May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: machine: x86_64 May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: clock source: unix May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: pcre jit disabled May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: detected number of CPU cores: 4 May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: current working directory: / May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: detected binary path: /usr/bin/uwsgi-core May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: your processes number limit is 47680 May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: your memory page size is 4096 bytes May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: detected max file descriptor number: 2048 May 09 09:38:20.254020 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: lock engine: pthread robust mutexes May 09 09:38:20.254979 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: thunder lock: enabled May 09 09:38:20.254979 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 09:38:20.254979 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 09:38:20.298563 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: Python main interpreter initialized at 0x558a748489c0 May 09 09:38:20.298563 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: python threads support enabled May 09 09:38:20.298563 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: your server socket listen backlog is limited to 100 connections May 09 09:38:20.298563 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: your mercy for graceful operations on workers is 90 seconds May 09 09:38:20.298925 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: mapped 403077 bytes (393 KB) for 2 cores May 09 09:38:20.298925 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: *** Operational MODE: preforking *** May 09 09:38:20.299242 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: *** uWSGI is running in multiple interpreter mode *** May 09 09:38:20.299242 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: spawned uWSGI master process (pid: 109304) May 09 09:38:20.299405 dv-cinder-841083-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 09:38:20.299952 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: spawned uWSGI worker 1 (pid: 109305, cores: 1) May 09 09:38:20.300291 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: spawned uWSGI worker 2 (pid: 109306, cores: 1) May 09 09:38:20.301727 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 09:38:21.474762 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 09:38:21.475415 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 09:38:22.193916 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:38:22.193916 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: from cryptography.utils import int_from_bytes May 09 09:38:22.194207 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:38:22.194207 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: from cryptography.utils import int_from_bytes May 09 09:38:22.194207 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:38:22.194207 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: from cryptography.utils import int_from_bytes May 09 09:38:22.194462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:38:22.194462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: from cryptography.utils import int_from_bytes May 09 09:38:24.745029 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 09:38:24.745735 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 09:38:24.745828 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 09:38:24.746156 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 09:38:24.746415 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 09:38:24.746802 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.747159 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.747484 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.747806 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.748140 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.748456 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.748810 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.749123 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.749456 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.749724 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.750065 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.750169 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 09:38:24.750542 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 09:38:24.750628 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841083-1-iscsi {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.750702 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.750849 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 09:38:24.750971 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.751206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 09:38:24.751369 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.751467 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 09:38:24.751599 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.751826 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.751929 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.752152 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.752256 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.752475 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.752574 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.752820 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.753013 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.753164 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.753462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.753570 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.753776 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.753873 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.754092 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.754182 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.754419 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.754523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.754683 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.754778 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755000 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755094 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755331 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841083-1-iscsi {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755441 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755650 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755746 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.755963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.756057 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.756275 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.756365 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.756595 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.756703 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841083-1-iscsi {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.756929 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.757018 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.757259 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.757363 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.757564 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.757657 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758021 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758112 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758339 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758477 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758667 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758796 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.758966 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.759096 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.759292 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.759391 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.759605 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.759691 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.759916 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760000 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760243 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760399 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760556 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760655 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760905 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.760995 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.761212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.761306 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.761523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.761663 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841083-1-iscsi {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.761834 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.761972 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.762180 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.762310 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.762567 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.762662 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.762876 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.762962 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.763132 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.763283 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.763443 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.763594 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.763768 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.763939 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.764094 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.764245 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.764422 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.764555 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.764702 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.764910 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765006 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765235 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765347 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765559 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765653 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765872 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.765969 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.766173 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.766258 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.766482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.766583 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.766783 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.766876 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767090 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767188 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767400 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767503 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767701 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767798 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.767955 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.768041 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.768264 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.768351 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.768586 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.768716 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.768933 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769259 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769366 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769513 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769611 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769766 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.769974 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.770070 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.770230 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.770396 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.770526 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.770706 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.770872 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771016 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771198 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771325 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771547 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771688 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771829 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.771921 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.772156 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.772242 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.772467 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.772560 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.772803 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.772893 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.773118 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.773205 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.773442 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.773536 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.773765 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.773849 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774069 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774160 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774324 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774410 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774628 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774772 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.774934 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775020 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775258 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775344 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775568 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775667 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775879 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.775971 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.776188 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.776279 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.776494 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.776588 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.776840 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.776936 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.777152 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.777244 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.777467 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.777592 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.777792 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.777882 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778127 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778219 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778434 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778546 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778742 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778847 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.778992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.779080 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.779297 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.779391 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.779602 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.779702 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.779927 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780028 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780237 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780324 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780550 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780651 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780880 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.780976 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.781186 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.781280 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.781494 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.781587 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.781802 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.781888 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.782110 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.782203 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.782419 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.782510 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.782725 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.782815 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783033 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783119 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783339 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783430 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783646 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783743 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.783950 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.784036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.784267 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.784363 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.784570 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.784688 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.784906 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785000 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785214 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785300 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785519 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785682 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785822 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.785919 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.786123 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.786219 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.786430 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.786525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.786735 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.786827 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787041 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787138 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787344 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787442 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787650 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787750 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.787944 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788039 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788259 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788352 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788567 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788653 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788905 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.788997 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.789208 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.789302 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.789515 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.789605 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.789832 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.789916 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.790139 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.790232 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.790445 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.790543 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.790749 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.790840 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.791053 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.791139 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.791360 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.791447 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.791667 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.791758 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.791969 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.792079 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.792271 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.792395 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.792570 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.792737 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.792924 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.793071 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.793249 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.793410 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.793582 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.793727 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.793888 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.794040 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.794193 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.794361 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.794512 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:38:24.794680 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.794848 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795014 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795184 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795337 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795529 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795657 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795845 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.795976 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.796178 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.796287 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.796513 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.796612 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.796854 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.796951 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.797170 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.797264 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.797485 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.797580 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.797815 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.797912 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.798124 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.798243 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.798438 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.798566 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.798751 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.798897 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.799071 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.799221 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.799392 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.799538 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.799723 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.799857 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.800039 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.800173 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.800358 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.800504 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.800702 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.800863 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801010 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801183 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801330 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801506 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801664 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801825 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.801990 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.802141 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.802306 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.802455 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.802648 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.802770 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803000 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803096 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803313 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803399 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803636 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803759 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.803955 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.804051 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.804268 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.804354 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.804578 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.804678 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.804914 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805017 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805239 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805326 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805550 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805643 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805860 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.805955 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.806167 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.806261 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.806479 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.806570 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.806792 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.806877 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.807100 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.807185 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.807408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.807499 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.807719 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.807915 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.808038 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.808124 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.808358 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.808443 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.808702 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.808793 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809021 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809137 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809370 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809466 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809684 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809815 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.809997 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810082 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810305 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810404 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810611 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810697 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810915 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.810999 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.811218 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.811312 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.811528 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.811615 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.811832 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.811917 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.812150 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.812245 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.812457 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.812550 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.812792 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.812882 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.813117 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.813215 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.813426 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.813512 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.813737 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.813830 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814047 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814132 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814357 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814451 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814664 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814751 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.814977 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.815063 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.815287 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.815373 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.815592 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.815678 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.815919 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816006 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816230 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816325 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816535 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816630 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816888 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.816983 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.817198 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.817284 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.817502 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.817601 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.817814 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.817918 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.818117 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.818204 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.818422 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.818526 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.818729 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.818816 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819038 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819157 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819342 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819437 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819650 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819747 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.819960 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.820046 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.820264 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.820362 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.820570 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.820677 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.820932 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821069 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821260 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821347 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821586 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821677 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821893 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.821980 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.822196 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.822282 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.822507 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.822593 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.822818 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.822904 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.823123 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.823210 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.823428 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.823514 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.823737 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.823826 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824042 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824128 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824349 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824445 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824707 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824810 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.824999 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.825086 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.825302 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.825388 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.825624 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.825722 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.825932 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826025 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826237 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826335 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826540 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826635 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826844 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.826929 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.827177 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.827262 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.827482 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.827576 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.827808 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.827892 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.828131 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.828217 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.828439 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.828533 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.828782 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.828873 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.829095 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.829183 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.829412 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.829501 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.829722 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.829807 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830034 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830120 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830347 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830434 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830656 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830742 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.830968 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831066 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831276 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831364 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831585 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831676 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831891 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.831983 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.832211 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.832296 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.832518 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.832653 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.832850 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833002 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833159 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833290 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833472 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833606 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833780 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.833921 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.834099 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.834234 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.834405 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.834547 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.834720 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.834871 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835039 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835172 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835353 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835488 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835662 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835806 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.835970 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.836099 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.836279 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.836427 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.836588 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.836817 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.836958 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837093 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837227 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837359 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837531 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837665 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837836 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.837965 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.838148 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.838279 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.838454 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.838549 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.838768 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.838860 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.839068 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.839153 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.839375 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.839466 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.839689 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.839783 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.840006 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.840099 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.840403 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.840506 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.840736 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.840838 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841054 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841154 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841367 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841456 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841681 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841775 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.841996 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.842091 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.842305 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.842391 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.842614 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.842713 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.842918 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843016 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843235 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843319 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843546 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843630 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843853 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.843961 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.844157 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.844241 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.844463 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.844548 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.844789 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.844878 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.845098 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.845184 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.845404 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.845491 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.845716 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.845810 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846040 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846133 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846349 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846434 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846663 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846748 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.846978 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847072 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847282 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847366 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847587 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847681 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847908 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.847995 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.848217 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.848353 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.848518 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.848603 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.848853 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.848940 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.849158 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.849260 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.849468 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.849553 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.849794 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.849880 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.850095 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.850192 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.850410 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.850494 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.850721 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.850815 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851026 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851120 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851336 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851420 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851642 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851733 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.851953 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.852212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.852303 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.852550 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.852635 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.852894 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.852993 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.853202 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.853294 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.853512 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.853598 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.853823 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.853921 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.854131 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.854217 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.854452 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.854538 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.854761 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.854856 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.855072 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.855166 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.855380 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.855473 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.855682 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.855768 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.856011 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.856098 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.856326 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.856414 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.856635 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.856908 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857010 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857240 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857327 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857554 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857638 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857862 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.857960 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.858167 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.858254 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.858472 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.858566 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.858775 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.858862 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.859091 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.859176 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.859398 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.859492 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.859709 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.859816 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860021 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860118 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860325 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860409 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860630 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860821 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.860966 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861051 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861270 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861355 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861578 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861675 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.861963 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.862191 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.862278 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.862496 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.862584 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.863112 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.863203 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.863415 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.863510 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.863717 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.863804 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864029 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864126 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864332 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864418 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864642 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864794 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.864965 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865052 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865286 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865385 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865592 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865678 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865893 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.865978 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.866193 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.866286 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.866495 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.866586 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.866803 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.866889 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.867113 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.867211 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.867420 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.867512 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.867725 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.867811 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868130 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868339 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868425 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868654 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868791 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.868988 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869091 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869291 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869378 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869593 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869712 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869897 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.869986 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.870203 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.870288 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.870505 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.870591 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.870806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.870899 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.871108 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.871193 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.871413 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.871838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.871838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872009 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872096 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872176 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872346 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872441 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872654 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872800 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.872983 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.873082 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.873289 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.873385 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.873611 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.873704 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.873921 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.874014 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.874226 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.874526 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.874619 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.874831 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.875083 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.875169 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.875428 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.875642 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.875729 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.876016 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.876105 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.876349 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.876504 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.876652 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.876985 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.877094 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.877293 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.877599 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.877696 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.877903 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.878175 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.878260 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.878503 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.878709 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.878803 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.879038 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.879123 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.879366 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.879453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.879676 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.879811 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.880010 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.880315 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.880401 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.880618 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.880949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881048 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881254 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881342 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881599 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881721 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881908 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.881995 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.882266 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.882358 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.882575 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.882661 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.882890 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.882975 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.883208 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.883302 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.883522 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.883619 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.883836 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.883923 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.884147 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.884232 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.884453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.884544 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.884862 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.884962 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.885177 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.885263 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.885486 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.885585 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.885801 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.885887 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.886105 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.886190 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.886411 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.886504 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.886718 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.886806 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.887026 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.887136 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.887357 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.887455 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.887685 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.887778 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888010 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888146 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888314 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888458 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888611 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888716 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.888949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.889080 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.889260 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.889391 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.889572 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.889701 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.889888 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890019 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890203 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890345 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890516 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890656 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890828 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.890959 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.891172 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.891306 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.891443 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.891571 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.891728 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.891860 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.892039 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.892127 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.892350 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.892437 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.892656 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.892794 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893004 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893092 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893309 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893394 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893613 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893706 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.893924 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894010 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894229 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894323 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894539 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894632 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894844 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.894928 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.895177 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.895269 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.895505 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.895600 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.895820 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.895912 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.896123 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.896210 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.896436 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.896531 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.896775 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.896864 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.897088 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.897186 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.897399 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.897486 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.897704 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.897789 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898013 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898129 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898324 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898444 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898636 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898756 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.898948 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899071 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899257 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899379 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899567 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899686 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899878 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.899999 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.900184 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.900319 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.900510 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.900628 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.900848 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.900955 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.901155 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.901241 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.901466 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.901552 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.901772 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.901867 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.902082 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.902175 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.902389 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.902583 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.902874 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.902972 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.903193 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.903282 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.903507 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.903685 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.903825 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904002 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904139 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904316 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904452 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904645 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904795 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.904993 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.905111 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.905323 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.905410 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.905633 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.905827 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.905951 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.906139 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.906264 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.906452 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.906593 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.906765 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.906923 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.907071 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.907233 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.907377 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.907550 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.907688 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.907877 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.908014 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.908199 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.908320 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.908527 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.908621 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.908885 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909017 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909215 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909313 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909550 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909646 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909874 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.909961 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.910258 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.910393 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.910585 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.910723 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.910904 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911056 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911217 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911350 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911524 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911657 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911841 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.911980 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.912150 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.912280 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.912458 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.912588 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.912809 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.912942 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.913119 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.913251 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.913434 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.913577 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.913748 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.913882 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.914060 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.914203 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.914366 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.914509 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.914673 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.914808 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915000 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915151 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915292 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915438 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915619 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915753 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.915935 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.916077 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.916253 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.916399 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.916577 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.916792 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.916924 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917077 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917244 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917376 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917555 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917697 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917861 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.917997 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.918168 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.918299 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.918501 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.918645 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.918845 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.918975 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.919152 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.919286 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.919458 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.919588 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.919766 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.919896 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.920093 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.920224 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.920400 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.920488 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.920740 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.920844 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921054 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921142 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921365 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921452 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921672 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921771 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.921976 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.922063 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.922291 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.922434 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.922595 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.922738 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.922906 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923059 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923349 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923518 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923661 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923823 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.923958 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.924130 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.924263 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.924432 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.924575 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.924761 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.924894 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925049 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925183 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925358 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925487 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925663 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925792 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.925983 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926112 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926293 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926423 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926600 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926740 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926906 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.926993 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.927212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.927299 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.927544 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.927630 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.927851 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.927948 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.928184 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.928272 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.928499 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.928584 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.928843 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.928945 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.929174 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.929266 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.929464 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.929551 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.929768 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.929865 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.930076 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.930163 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.930380 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.930524 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.930741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.930878 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931024 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931162 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931295 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931435 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931582 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931727 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931861 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.931995 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.932127 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.932257 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.932441 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.932530 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.932766 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.932869 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.933092 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.933180 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.933399 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.933681 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.933769 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.934037 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.934128 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.934392 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.934486 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.934710 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.934795 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935027 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935113 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935340 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935425 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935654 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935740 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.935971 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.936065 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.936286 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.936374 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.936596 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.936695 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.936946 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937047 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937265 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937352 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937583 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937669 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937902 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.937996 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.938220 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.938315 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.938537 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.938623 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.938852 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.938945 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.939167 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.939288 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.939480 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.939567 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.939808 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.939904 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.940125 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.940221 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.940442 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.940528 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.940781 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.940997 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.941105 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.941327 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.941413 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.941641 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.941740 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.941956 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942043 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942271 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942358 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942591 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942689 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942902 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.942989 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.943216 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.943302 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.943525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.943619 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.943835 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.943921 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.944149 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.944243 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.944480 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.944568 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.944829 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.944930 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.945147 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.945239 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.945465 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.945554 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.945783 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.945868 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.946098 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.946303 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.946413 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.946621 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.946730 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.946957 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.947092 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.947289 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.947429 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.947705 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.947897 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.948017 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.948222 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.948333 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.948546 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.948635 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.948909 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949011 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949220 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949324 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949530 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949636 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949875 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.949963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.950188 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.950283 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.950491 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.950587 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.950803 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.950897 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.951118 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.951205 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.951426 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.951513 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.951750 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.951969 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.952058 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.952552 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.952649 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.952948 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.953143 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.953269 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.953587 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.953682 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.953916 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.954066 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.954239 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.954551 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.954880 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.954999 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.955190 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.955499 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.955584 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.955820 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.956117 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.956205 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.956432 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.956517 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.956763 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.956857 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.957083 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.957259 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.957394 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.957700 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.957851 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.958013 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.958323 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.958408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.958651 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.958738 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.958960 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.959049 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.959268 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.959356 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.959581 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.959745 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.959891 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960027 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960195 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960336 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960504 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960654 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960842 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.960930 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.961150 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.961237 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.961465 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.961627 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.961773 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962004 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962098 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962357 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962444 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962679 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962767 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.962986 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.963073 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.963299 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.963395 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.963636 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.963733 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.963950 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.964037 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.964263 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.964406 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.964568 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.964745 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.964916 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.965007 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.965249 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.965419 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.965635 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.965775 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.965945 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.966079 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.966257 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.966401 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.966574 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.966716 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.966888 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.967024 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.967199 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.967428 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.967521 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.967766 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.967854 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.968091 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.968190 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.968420 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.968508 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.968752 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.968855 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969063 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969160 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969378 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969465 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969690 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969831 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.969997 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.970134 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.970310 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.970444 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.970619 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.970751 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.970928 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971021 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971234 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971327 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971546 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971639 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971854 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.971947 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.972162 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.972248 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.972471 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.972557 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.972808 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.972898 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.973119 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.973204 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.973434 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.973531 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.973748 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.973836 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.974060 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.974145 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.974376 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.974472 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.974689 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.974777 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975013 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975099 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975327 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975424 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975633 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975727 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.975942 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.976035 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.976253 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.976358 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.976563 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.976827 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.976917 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.977164 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.977285 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.977486 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.977574 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.977822 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.977928 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.978126 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.978225 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.978451 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.978536 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.978758 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.978844 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.979067 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.979162 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.979391 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.979478 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.979703 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.979824 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.980016 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.980166 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.980325 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.980497 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.980651 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.980931 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981041 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981258 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981352 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981572 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981904 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.981999 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.982210 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.982304 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.982526 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.982613 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.982838 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.982936 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.983149 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.983237 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.983464 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.983549 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.983771 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.983859 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.984081 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.984175 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.984402 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.984489 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.984741 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.984832 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985052 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985139 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985357 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985446 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985668 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985764 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.985973 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986060 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986278 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986374 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986582 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986668 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986885 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.986971 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.987193 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.987292 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.987496 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.987587 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.988121 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.988221 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.988425 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.988521 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.988758 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.988858 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989070 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989374 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989475 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989687 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989774 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.989992 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.990100 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.990300 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.990417 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.990605 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.990740 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.990916 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.991053 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.991230 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.991383 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.991535 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.991723 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.991873 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.992057 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.992189 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.992392 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.992514 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.992722 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.992858 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993022 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993193 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993324 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993509 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993639 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993832 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.993977 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.994159 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.994295 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.994477 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.994611 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.994789 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.994936 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.995102 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.995239 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.995407 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.995542 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.995711 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.995865 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.996016 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.996111 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.996321 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.996408 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.996713 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.996805 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997022 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997109 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997328 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997415 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997633 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997723 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.997939 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998033 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998244 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998331 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998547 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998634 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998855 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.998944 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.999157 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.999252 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.999462 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.999548 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.999764 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:24.999851 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.000067 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.000163 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.000371 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.000457 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.000727 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.000818 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001044 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001143 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001359 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001454 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001675 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001774 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.001984 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.002079 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.002310 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.002403 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.002625 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.002717 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.002948 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003084 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003269 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003356 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003584 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003677 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003893 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.003983 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.004225 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.004321 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.004539 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.004627 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.004879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.004973 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.005193 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.005281 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.005503 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.005588 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.005754 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109305) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 09:38:25.005842 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.006108 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.006434 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.006763 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.007069 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.007394 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.007714 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.008034 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.008350 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.008687 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.009014 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.009327 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.009639 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.009957 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.010268 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.010594 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.010913 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.011234 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.011562 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.011890 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.012343 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.012700 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.013054 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.013368 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.013714 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.014047 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.014365 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.014680 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.014986 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:38:25.015233 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109306) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 09:38:25.029217 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_db.sqlalchemy.engines [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.038173 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.093990 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.context [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3fa34f5-2fe2-4198-819d-4854c40b59aa(cell1) {{(pid=109305) load_cells /opt/stack/nova/nova/context.py:464}} May 09 09:38:25.098415 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:38:25.099971 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:38:25.100752 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:38:25.102685 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:38:25.106259 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.context [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3fa34f5-2fe2-4198-819d-4854c40b59aa(cell1) {{(pid=109306) load_cells /opt/stack/nova/nova/context.py:464}} May 09 09:38:25.110620 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_concurrency.lockutils [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:38:25.112229 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_concurrency.lockutils [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:38:25.113386 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_concurrency.lockutils [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:38:25.114768 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_db.sqlalchemy.engines [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.115359 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_concurrency.lockutils [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109306) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:38:25.117430 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_db.sqlalchemy.engines [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.128778 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.132489 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.272435 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_db.sqlalchemy.engines [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109305) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.286974 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109306) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:38:25.608294 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: WARNING keystonemiddleware.auth_token [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:38:25.613476 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: WARNING keystonemiddleware.auth_token [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:38:25.615968 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: WARNING keystonemiddleware.auth_token [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:38:25.620825 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: WARNING keystonemiddleware.auth_token [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:38:25.954059 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: WARNING keystonemiddleware.auth_token [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:38:25.958484 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: WARNING keystonemiddleware.auth_token [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:38:25.960043 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: WARNING keystonemiddleware.auth_token [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:38:25.964554 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: WARNING keystonemiddleware.auth_token [None req-cc9216a2-fb5d-48e1-ab90-464d2b483059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:38:25.966199 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a748489c0 pid: 109305 (default app) May 09 09:38:25.968246 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:38:25.969437 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 May 09 09:38:25.969848 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon May 9 09:38:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:38:25.970899 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a748489c0 pid: 109306 (default app) May 09 09:39:43.411130 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:43.412449 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 09 09:39:43.413050 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:43.848742 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-ffcb04c7-dca8-4fe0-a7e6-8ba80b92f7d5 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:43.877811 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-ffcb04c7-dca8-4fe0-a7e6-8ba80b92f7d5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.457879 May 09 09:39:43.878616 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Mon May 9 09:39:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:39:46.125631 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:46.126638 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-55564ff3-283b-45fb-9943-c24a92bb9de0 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 09 09:39:46.127034 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:46.186767 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-8d12ee43-191f-400e-af54-e7ce32c3f305 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "vcpus": 1, "id": "c1", "ram": 256, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:46.205677 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:39:46.205677 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: warnings.warn(msg) May 09 09:39:46.233682 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-8d12ee43-191f-400e-af54-e7ce32c3f305 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100626 May 09 09:39:46.234832 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:39:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:39:46.447246 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-2919f730-d1d5-4baf-8f17-cca32aaccf17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:46.449732 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:39:46.449732 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: warnings.warn(msg) May 09 09:39:46.499903 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-2919f730-d1d5-4baf-8f17-cca32aaccf17 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257056 May 09 09:39:46.500624 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Mon May 9 09:39:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:39:48.793931 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-8d12ee43-191f-400e-af54-e7ce32c3f305 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:48.795049 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-8d12ee43-191f-400e-af54-e7ce32c3f305 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 May 09 09:39:48.795536 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:48.903848 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-848a394b-9d94-4929-8398-b509adef8a2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "disk": 5, "vcpus": 1}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:48.921776 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:39:48.921776 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: warnings.warn(msg) May 09 09:39:48.940262 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-848a394b-9d94-4929-8398-b509adef8a2a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138559 May 09 09:39:48.940854 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:39:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:39:48.952481 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-2d9f095f-4b50-494f-86bb-a0b645f65d59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:48.953990 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:39:48.953990 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: warnings.warn(msg) May 09 09:39:48.986005 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-2d9f095f-4b50-494f-86bb-a0b645f65d59 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037140 May 09 09:39:48.986730 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Mon May 9 09:39:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:39:51.259371 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-848a394b-9d94-4929-8398-b509adef8a2a admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:51.260381 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-848a394b-9d94-4929-8398-b509adef8a2a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 May 09 09:39:51.261085 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:51.325426 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-9448564d-85e4-4df8-a781-ee467846f828 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:51.345005 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-9448564d-85e4-4df8-a781-ee467846f828 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077252 May 09 09:39:51.351126 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:39:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:39:51.357873 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-c1823c60-029c-4a77-b05d-459f550ff436 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:51.381723 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-c1823c60-029c-4a77-b05d-459f550ff436 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027615 May 09 09:39:51.382523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Mon May 9 09:39:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:39:53.652145 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-9448564d-85e4-4df8-a781-ee467846f828 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:53.653219 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-9448564d-85e4-4df8-a781-ee467846f828 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 May 09 09:39:53.653626 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:53.714276 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-e65a47d1-59ae-450a-9f17-b5dd98aa3072 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "id": "d3", "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:53.733238 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-e65a47d1-59ae-450a-9f17-b5dd98aa3072 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073199 May 09 09:39:53.733811 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:39:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:39:53.745845 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-c9cd7b35-3c4c-46c9-a606-0a2f8dbfdd47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:53.768963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-c9cd7b35-3c4c-46c9-a606-0a2f8dbfdd47 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026693 May 09 09:39:53.769551 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Mon May 9 09:39:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:39:56.014997 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-e65a47d1-59ae-450a-9f17-b5dd98aa3072 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:56.016019 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-e65a47d1-59ae-450a-9f17-b5dd98aa3072 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 09 09:39:56.016606 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:56.075469 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-8d391ad1-89a1-46d5-be15-bc767451194a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d4", "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:56.095109 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-8d391ad1-89a1-46d5-be15-bc767451194a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072644 May 09 09:39:56.095858 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:39:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:39:56.107663 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-28f8e3f1-d2c9-428e-b3a8-a72987c16591 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:39:56.132333 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-28f8e3f1-d2c9-428e-b3a8-a72987c16591 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027673 May 09 09:39:56.133466 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Mon May 9 09:39:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:39:58.368304 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-8d391ad1-89a1-46d5-be15-bc767451194a admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:58.369459 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-8d391ad1-89a1-46d5-be15-bc767451194a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 May 09 09:39:58.369985 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:39:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:39:58.429572 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-1f935132-6257-4382-b51b-83f0b23a96d6 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:39:58.453536 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-1f935132-6257-4382-b51b-83f0b23a96d6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076643 May 09 09:39:58.454170 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Mon May 9 09:39:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:00.687765 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-8d391ad1-89a1-46d5-be15-bc767451194a admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:00.689263 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-8d391ad1-89a1-46d5-be15-bc767451194a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 09 09:40:00.689263 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:00.749135 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-3fbb4931-95f8-497b-9a2b-0e1842784011 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "disk": 1, "vcpus": 1}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:00.766635 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-3fbb4931-95f8-497b-9a2b-0e1842784011 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071625 May 09 09:40:00.767184 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:40:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:00.780738 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-081aeea9-0256-4071-9206-03cb897f5098 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:00.805227 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-081aeea9-0256-4071-9206-03cb897f5098 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028096 May 09 09:40:00.805895 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Mon May 9 09:40:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:40:03.062783 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-3fbb4931-95f8-497b-9a2b-0e1842784011 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:03.063798 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-3fbb4931-95f8-497b-9a2b-0e1842784011 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 09 09:40:03.064370 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:03.121188 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-c5fec56e-f474-4e04-9a9b-7308b7a4caee admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "name": "m1.small", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:03.140534 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-c5fec56e-f474-4e04-9a9b-7308b7a4caee admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070055 May 09 09:40:03.141082 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:40:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:40:03.155724 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-6bc3a8cf-d4ac-4920-9e09-768a1ec98280 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:03.182628 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-6bc3a8cf-d4ac-4920-9e09-768a1ec98280 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030672 May 09 09:40:03.183300 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Mon May 9 09:40:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:40:05.474977 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-c5fec56e-f474-4e04-9a9b-7308b7a4caee admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:05.476000 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-c5fec56e-f474-4e04-9a9b-7308b7a4caee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 09 09:40:05.476408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:40:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:05.541450 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-65757bb1-f9fc-482b-8a82-47bc853e2321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "name": "m1.medium", "vcpus": 2, "id": "3", "swap": 0}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:05.563025 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-65757bb1-f9fc-482b-8a82-47bc853e2321 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080443 May 09 09:40:05.563581 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:40:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:40:05.575675 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-6295dbe3-bf1b-4b80-9ad3-34b444dc8878 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:05.598928 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-6295dbe3-bf1b-4b80-9ad3-34b444dc8878 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027054 May 09 09:40:05.599522 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Mon May 9 09:40:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:40:07.850412 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-65757bb1-f9fc-482b-8a82-47bc853e2321 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:07.851788 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-65757bb1-f9fc-482b-8a82-47bc853e2321 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 09 09:40:07.852458 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:40:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:07.912973 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-42e1d411-24ed-4c9e-9f2d-c561e577cd2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "id": "4"}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:07.932315 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-42e1d411-24ed-4c9e-9f2d-c561e577cd2c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072977 May 09 09:40:07.932915 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:40:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:07.946313 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-a996efa1-deb4-429d-b38a-c7d2f7885aa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:07.973719 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-a996efa1-deb4-429d-b38a-c7d2f7885aa3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032027 May 09 09:40:07.974654 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Mon May 9 09:40:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:40:10.230014 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-42e1d411-24ed-4c9e-9f2d-c561e577cd2c admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:10.231018 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-42e1d411-24ed-4c9e-9f2d-c561e577cd2c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 May 09 09:40:10.231415 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:10.289963 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-7b36d7b2-2077-4fe6-a8d2-a12fb32d4590 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:10.307895 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-7b36d7b2-2077-4fe6-a8d2-a12fb32d4590 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070221 May 09 09:40:10.308695 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Mon May 9 09:40:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:10.320469 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-2da5d8cd-1963-4219-8ed4-a843f839975c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:10.343732 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-2da5d8cd-1963-4219-8ed4-a843f839975c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027017 May 09 09:40:10.344309 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Mon May 9 09:40:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:40:38.018984 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-7b36d7b2-2077-4fe6-a8d2-a12fb32d4590 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:38.020283 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-7b36d7b2-2077-4fe6-a8d2-a12fb32d4590 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 May 09 09:40:38.020825 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:38.086117 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-0cd1bde8-fa21-44f9-bb1d-c38f88278385 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:38.104548 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-0cd1bde8-fa21-44f9-bb1d-c38f88278385 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077570 May 09 09:40:38.105127 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Mon May 9 09:40:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:39.138822 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-7b36d7b2-2077-4fe6-a8d2-a12fb32d4590 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:39.140137 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-7b36d7b2-2077-4fe6-a8d2-a12fb32d4590 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 May 09 09:40:39.140640 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:39.350347 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-ce22ca7e-6f64-412c-9ee5-b8397f7052bc admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:39.356303 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.wsgi [None req-ce22ca7e-6f64-412c-9ee5-b8397f7052bc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-ce22ca7e-6f64-412c-9ee5-b8397f7052bc admin admin] Request method failure captured: May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Accept: application/json May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Accept-Encoding: gzip, deflate May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Connection: keep-alive May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Content-Length: 0 May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Host: 10.222.0.26 May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Openstack-Api-Version: compute 2.90 May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Openstack-System-Scope: None May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: User-Agent: python-novaclient May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Auth-Token: gAAAAABieOGX9DqbvjJUuYMSJZS2VDY2KS5Fg8oCwP-zN_qIn3OiNAcyBuYes2DogmHwzfsfVo1kxqFd_NAtzZ40RGAAER8ZmXWzbFlH-ttYJvLwxlhb0JbyDRNcJlMTNU5NdQWUbKCeRS4p32Buw3XSY-ggQqOi03fT2uxAESCKxFmzXJjNVpo May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Domain-Id: None May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Domain-Name: None May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Identity-Status: Confirmed May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Is-Admin-Project: True May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Openstack-Nova-Api-Version: 2.90 May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Domain-Id: default May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Domain-Name: Default May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Name: admin May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Role: member,admin,reader May 09 09:40:39.360450 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Roles: member,admin,reader May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03d8c548fb514d70b477284ceb7b3252", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant: admin May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant-Name: admin May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User: admin May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Domain-Id: default May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Domain-Name: Default May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Id: 68d9ab86ee454d7d9d1e4d3a48048d52 May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Name: admin May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: method: > May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: exception: Flavor 42 could not be found. May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: action_args: {'id': '42'} May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:40:39.362525 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:39.363520 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:39.364806 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-ce22ca7e-6f64-412c-9ee5-b8397f7052bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:40:39.365916 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-ce22ca7e-6f64-412c-9ee5-b8397f7052bc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067602 May 09 09:40:39.365916 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon May 9 09:40:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 09:40:39.373728 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-e08994fc-4e6a-4c79-89c3-8b22a06d7d83 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:39.396152 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-e08994fc-4e6a-4c79-89c3-8b22a06d7d83 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026055 May 09 09:40:39.396941 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon May 9 09:40:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:40:39.420609 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-ea2dcec4-4382-419a-ae52-b1dd35c3d5f4 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:39.447592 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-ea2dcec4-4382-419a-ae52-b1dd35c3d5f4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033156 May 09 09:40:39.448136 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon May 9 09:40:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:39.460833 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-df6fd3e5-50d1-4645-bb26-7164c83ea836 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:39.466742 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.wsgi [None req-df6fd3e5-50d1-4645-bb26-7164c83ea836 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-df6fd3e5-50d1-4645-bb26-7164c83ea836 admin admin] Request method failure captured: May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Accept: application/json May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Accept-Encoding: gzip, deflate May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Connection: keep-alive May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Content-Length: 0 May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Host: 10.222.0.26 May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Openstack-Api-Version: compute 2.90 May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Openstack-System-Scope: None May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: User-Agent: python-novaclient May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Auth-Token: gAAAAABieOGX9DqbvjJUuYMSJZS2VDY2KS5Fg8oCwP-zN_qIn3OiNAcyBuYes2DogmHwzfsfVo1kxqFd_NAtzZ40RGAAER8ZmXWzbFlH-ttYJvLwxlhb0JbyDRNcJlMTNU5NdQWUbKCeRS4p32Buw3XSY-ggQqOi03fT2uxAESCKxFmzXJjNVpo May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Domain-Id: None May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Domain-Name: None May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Identity-Status: Confirmed May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Is-Admin-Project: True May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Openstack-Nova-Api-Version: 2.90 May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Domain-Id: default May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Domain-Name: Default May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Name: admin May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Role: member,admin,reader May 09 09:40:39.470020 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Roles: member,admin,reader May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03d8c548fb514d70b477284ceb7b3252", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant: admin May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant-Name: admin May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User: admin May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Domain-Id: default May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Domain-Name: Default May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Id: 68d9ab86ee454d7d9d1e4d3a48048d52 May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Name: admin May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: method: > May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: exception: Flavor 42 could not be found. May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: action_args: {'id': '42'} May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:40:39.471462 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:39.472453 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:39.473838 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-df6fd3e5-50d1-4645-bb26-7164c83ea836 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:40:39.474854 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-df6fd3e5-50d1-4645-bb26-7164c83ea836 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016684 May 09 09:40:39.474854 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon May 9 09:40:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 09:40:40.388797 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-ea2dcec4-4382-419a-ae52-b1dd35c3d5f4 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:40.389882 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-ea2dcec4-4382-419a-ae52-b1dd35c3d5f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 09 09:40:40.390277 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:40.586701 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-0cfebdf8-9bf5-41b2-8c28-7e395633d50b admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:40.592461 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.wsgi [None req-0cfebdf8-9bf5-41b2-8c28-7e395633d50b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-0cfebdf8-9bf5-41b2-8c28-7e395633d50b admin admin] Request method failure captured: May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Accept: application/json May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Accept-Encoding: gzip, deflate May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Connection: keep-alive May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Content-Length: 0 May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Host: 10.222.0.26 May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Openstack-Api-Version: compute 2.90 May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Openstack-System-Scope: None May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: User-Agent: python-novaclient May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Auth-Token: gAAAAABieOGYAyzMMBnmp-bLbJtM5JQHgGG_Oo-fBq7BiEQoumcxsHquzSUfGFwWyX-pa0c0e01Ub_jBB7a2pbspu06wDD4uBNAu3cBup1aHjeYNA_14qefr9qgcYYA-uSGXqSABcplAXow-QOsQ4_-Hkvb4zmBb_CLFpG8dzfAL1UUXWKk0JAU May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Domain-Id: None May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Domain-Name: None May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Identity-Status: Confirmed May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Is-Admin-Project: True May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Openstack-Nova-Api-Version: 2.90 May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Domain-Id: default May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Domain-Name: Default May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Name: admin May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Role: member,admin,reader May 09 09:40:40.593949 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Roles: member,admin,reader May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03d8c548fb514d70b477284ceb7b3252", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant: admin May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant-Name: admin May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User: admin May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Domain-Id: default May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Domain-Name: Default May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Id: 68d9ab86ee454d7d9d1e4d3a48048d52 May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Name: admin May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: method: > May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: exception: Flavor 84 could not be found. May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: action_args: {'id': '84'} May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:40:40.595482 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:40.596320 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:40.597523 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-0cfebdf8-9bf5-41b2-8c28-7e395633d50b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:40:40.598714 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-0cfebdf8-9bf5-41b2-8c28-7e395633d50b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068256 May 09 09:40:40.598714 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon May 9 09:40:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 09:40:40.605442 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-8492724d-a857-4a9e-96f3-cb8f726ac7f0 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:40.619738 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-8492724d-a857-4a9e-96f3-cb8f726ac7f0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018020 May 09 09:40:40.620265 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon May 9 09:40:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:40.629567 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-ff2be7ef-67d4-467e-82ac-72781a9534c6 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:40.643531 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-ff2be7ef-67d4-467e-82ac-72781a9534c6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017500 May 09 09:40:40.644049 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon May 9 09:40:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:40.653379 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-cd934cc4-3342-4f9e-b314-590414a33c2e admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:40.658893 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.wsgi [None req-cd934cc4-3342-4f9e-b314-590414a33c2e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-cd934cc4-3342-4f9e-b314-590414a33c2e admin admin] Request method failure captured: May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Accept: application/json May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Accept-Encoding: gzip, deflate May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Connection: keep-alive May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Content-Length: 0 May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Host: 10.222.0.26 May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Openstack-Api-Version: compute 2.90 May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Openstack-System-Scope: None May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: User-Agent: python-novaclient May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Auth-Token: gAAAAABieOGYAyzMMBnmp-bLbJtM5JQHgGG_Oo-fBq7BiEQoumcxsHquzSUfGFwWyX-pa0c0e01Ub_jBB7a2pbspu06wDD4uBNAu3cBup1aHjeYNA_14qefr9qgcYYA-uSGXqSABcplAXow-QOsQ4_-Hkvb4zmBb_CLFpG8dzfAL1UUXWKk0JAU May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Domain-Id: None May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Domain-Name: None May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Identity-Status: Confirmed May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Is-Admin-Project: True May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Openstack-Nova-Api-Version: 2.90 May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Domain-Id: default May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Domain-Name: Default May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Name: admin May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Role: member,admin,reader May 09 09:40:40.660408 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Roles: member,admin,reader May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03d8c548fb514d70b477284ceb7b3252", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant: admin May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant-Name: admin May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User: admin May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Domain-Id: default May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Domain-Name: Default May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Id: 68d9ab86ee454d7d9d1e4d3a48048d52 May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Name: admin May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: method: > May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: exception: Flavor 84 could not be found. May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: action_args: {'id': '84'} May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:40:40.661963 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:40.662879 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:40.663992 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-cd934cc4-3342-4f9e-b314-590414a33c2e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:40:40.665131 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-cd934cc4-3342-4f9e-b314-590414a33c2e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011903 May 09 09:40:40.665131 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon May 9 09:40:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 09:40:41.538422 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-ff2be7ef-67d4-467e-82ac-72781a9534c6 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:41.539562 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-ff2be7ef-67d4-467e-82ac-72781a9534c6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 09 09:40:41.539969 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:41.729574 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-7b1d723a-a5f9-4516-b143-703d3685709f admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:41.735390 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.wsgi [None req-7b1d723a-a5f9-4516-b143-703d3685709f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-7b1d723a-a5f9-4516-b143-703d3685709f admin admin] Request method failure captured: May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Accept: application/json May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Accept-Encoding: gzip, deflate May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Connection: keep-alive May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Content-Length: 0 May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Host: 10.222.0.26 May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Openstack-Api-Version: compute 2.90 May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Openstack-System-Scope: None May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: User-Agent: python-novaclient May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Auth-Token: gAAAAABieOGZa8iciy-dnuutQNHWGUX4anVkDCAVv9nzHQmSCg2f6JiFqHSOFJy-NGmBqi8XCyfiHVP87sgLUGIbFBjMc2oMaLbC2BZaW4OzE_IslG4p3nmbcNHMra9ymNE_ibAYE5rv6pGzf96RCdFo0Vw8X8qSoixsaaN6G8CI5b1zsBojK1w May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Domain-Id: None May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Domain-Name: None May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Identity-Status: Confirmed May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Is-Admin-Project: True May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Openstack-Nova-Api-Version: 2.90 May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Domain-Id: default May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Domain-Name: Default May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Project-Name: admin May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Role: member,admin,reader May 09 09:40:41.737163 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Roles: member,admin,reader May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03d8c548fb514d70b477284ceb7b3252", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant: admin May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-Tenant-Name: admin May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User: admin May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Domain-Id: default May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Domain-Name: Default May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Id: 68d9ab86ee454d7d9d1e4d3a48048d52 May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: X-User-Name: admin May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: method: > May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: exception: Flavor 451 could not be found. May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: action_args: {'id': '451'} May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:40:41.738658 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:41.739741 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: ERROR nova.api.openstack.wsgi May 09 09:40:41.741206 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-7b1d723a-a5f9-4516-b143-703d3685709f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109306) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:40:41.742541 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-7b1d723a-a5f9-4516-b143-703d3685709f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063201 May 09 09:40:41.742541 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon May 9 09:40:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 09:40:41.748480 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-a66a69c4-5123-44fa-b666-5c330937c881 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:41.762325 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-a66a69c4-5123-44fa-b666-5c330937c881 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017461 May 09 09:40:41.762826 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon May 9 09:40:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:41.772129 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:41.785704 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017107 May 09 09:40:41.786219 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon May 9 09:40:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:40:41.800232 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-edc46fcf-ddb6-4e59-87e6-dac9d1a90973 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:41.807228 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.wsgi [None req-edc46fcf-ddb6-4e59-87e6-dac9d1a90973 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-edc46fcf-ddb6-4e59-87e6-dac9d1a90973 admin admin] Request method failure captured: May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Accept: application/json May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Accept-Encoding: gzip, deflate May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Connection: keep-alive May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Content-Length: 0 May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Host: 10.222.0.26 May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Openstack-Api-Version: compute 2.90 May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Openstack-System-Scope: None May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: User-Agent: python-novaclient May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Auth-Token: gAAAAABieOGZa8iciy-dnuutQNHWGUX4anVkDCAVv9nzHQmSCg2f6JiFqHSOFJy-NGmBqi8XCyfiHVP87sgLUGIbFBjMc2oMaLbC2BZaW4OzE_IslG4p3nmbcNHMra9ymNE_ibAYE5rv6pGzf96RCdFo0Vw8X8qSoixsaaN6G8CI5b1zsBojK1w May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Domain-Id: None May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Domain-Name: None May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Identity-Status: Confirmed May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Is-Admin-Project: True May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Openstack-Nova-Api-Version: 2.90 May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Domain-Id: default May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Domain-Name: Default May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Project-Name: admin May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Role: member,admin,reader May 09 09:40:41.808749 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Roles: member,admin,reader May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/03d8c548fb514d70b477284ceb7b3252"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_03d8c548fb514d70b477284ceb7b3252", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant: admin May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant-Id: 03d8c548fb514d70b477284ceb7b3252 May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-Tenant-Name: admin May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User: admin May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Domain-Id: default May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Domain-Name: Default May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Id: 68d9ab86ee454d7d9d1e4d3a48048d52 May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: X-User-Name: admin May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: method: > May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: exception: Flavor 451 could not be found. May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: action_args: {'id': '451'} May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:40:41.810212 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:41.811036 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: ERROR nova.api.openstack.wsgi May 09 09:40:41.812125 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-edc46fcf-ddb6-4e59-87e6-dac9d1a90973 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109305) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:40:41.813203 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-edc46fcf-ddb6-4e59-87e6-dac9d1a90973 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015618 May 09 09:40:41.813203 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon May 9 09:40:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 09 09:40:42.695779 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:42.696832 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 09 09:40:42.697222 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:42.893823 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-1844fccd-08e4-4c10-a7b5-63a80f1e87fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:42.912980 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-1844fccd-08e4-4c10-a7b5-63a80f1e87fa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080549 May 09 09:40:42.913484 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon May 9 09:40:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:43.792226 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:43.793247 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 09 09:40:43.793637 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:43.995835 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-95790ce6-e268-4442-83dd-c79a9482928a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:44.017211 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-95790ce6-e268-4442-83dd-c79a9482928a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085073 May 09 09:40:44.017751 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon May 9 09:40:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:44.910316 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:44.911325 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 09 09:40:44.911724 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:45.112992 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-088efef5-ce79-4520-ac5c-1ec1444acada admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:45.132921 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-088efef5-ce79-4520-ac5c-1ec1444acada admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085788 May 09 09:40:45.133382 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon May 9 09:40:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:46.030634 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:46.031635 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 09 09:40:46.032054 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:46.229845 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-9236fb53-9473-4e34-b151-e1e713be8656 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:40:46.255508 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-9236fb53-9473-4e34-b151-e1e713be8656 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.089199 May 09 09:40:46.256129 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon May 9 09:40:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:40:47.136810 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:47.137808 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 09 09:40:47.138202 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:40:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:40:47.337948 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-0c36c753-f5ba-430e-9806-aaa819e086d8 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:40:47.357103 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-0c36c753-f5ba-430e-9806-aaa819e086d8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083973 May 09 09:40:47.357569 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon May 9 09:40:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:41:48.909613 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:41:48.910704 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-24d37b5b-07ca-4d21-958c-1a580dcdceaa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 09 09:41:48.911103 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Mon May 9 09:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:41:48.974611 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-4538823e-3ed4-49d4-a36c-6e6f89ab564d admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:41:48.996459 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-4538823e-3ed4-49d4-a36c-6e6f89ab564d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079251 May 09 09:41:48.997018 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Mon May 9 09:41:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:41:49.019224 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-2deab680-92dd-4254-990e-4beff376dcc5 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:41:49.027343 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-2deab680-92dd-4254-990e-4beff376dcc5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012357 May 09 09:41:49.027864 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Mon May 9 09:41:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:41:49.041369 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-d4b20822-d9a3-4f28-a531-57fcee40885e admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:41:49.052730 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-d4b20822-d9a3-4f28-a531-57fcee40885e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016712 May 09 09:41:49.053381 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Mon May 9 09:41:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:41:49.064957 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:41:49.072473 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010899 May 09 09:41:49.073032 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Mon May 9 09:41:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:41:49.084053 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-4ceed971-0f48-47f0-9f9b-147010d0c463 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:41:49.091746 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-4ceed971-0f48-47f0-9f9b-147010d0c463 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011141 May 09 09:41:49.092284 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Mon May 9 09:41:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:45:12.927914 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:12.930135 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002623 May 09 09:45:12.930528 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:45:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:45:13.220862 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-635ca131-6091-47dd-b417-5544a98afc71 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:13.222014 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:45:13.222014 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: warnings.warn(msg) May 09 09:45:13.223221 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-635ca131-6091-47dd-b417-5544a98afc71 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:13.223620 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-635ca131-6091-47dd-b417-5544a98afc71 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:13.224397 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-635ca131-6091-47dd-b417-5544a98afc71 admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:13.224848 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-635ca131-6091-47dd-b417-5544a98afc71 admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:13.257778 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-635ca131-6091-47dd-b417-5544a98afc71 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165529 May 09 09:45:13.258343 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon May 9 09:45:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:45:14.156539 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:14.157571 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 09 09:45:14.157996 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:45:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:45:14.357381 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-fee9ec50-7b69-479d-b372-726e7f0900ea admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:14.358559 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:45:14.358559 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: warnings.warn(msg) May 09 09:45:14.359790 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-fee9ec50-7b69-479d-b372-726e7f0900ea admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:14.360181 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-fee9ec50-7b69-479d-b372-726e7f0900ea admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:14.360998 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-fee9ec50-7b69-479d-b372-726e7f0900ea admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:14.361421 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-fee9ec50-7b69-479d-b372-726e7f0900ea admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:14.382149 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-fee9ec50-7b69-479d-b372-726e7f0900ea admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076534 May 09 09:45:14.382729 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon May 9 09:45:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:45:25.740238 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:25.741308 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 09 09:45:25.741682 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:45:25.961266 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-251fc96b-9bd7-4c5c-a610-ef6febe5e11e admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:25.962455 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:45:25.962455 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: warnings.warn(msg) May 09 09:45:25.963627 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-251fc96b-9bd7-4c5c-a610-ef6febe5e11e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:25.964056 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-251fc96b-9bd7-4c5c-a610-ef6febe5e11e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:25.964907 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-251fc96b-9bd7-4c5c-a610-ef6febe5e11e admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:25.965321 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-251fc96b-9bd7-4c5c-a610-ef6febe5e11e admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:25.989402 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-251fc96b-9bd7-4c5c-a610-ef6febe5e11e admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.108020 May 09 09:45:25.989954 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon May 9 09:45:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:45:26.889228 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: DEBUG nova.api.openstack.wsgi [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] Calling method '>' {{(pid=109306) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:26.890357 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: INFO nova.api.openstack.requestlog [None req-90130304-91d0-474e-bcdc-f2be365e5df8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 May 09 09:45:26.890771 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: [pid: 109306|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon May 9 09:45:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:45:27.094957 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG nova.api.openstack.wsgi [None req-a22c813d-555c-4f98-82e0-22eda857d494 admin admin] Calling method '>' {{(pid=109305) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:45:27.096114 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 09 09:45:27.096114 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: warnings.warn(msg) May 09 09:45:27.097340 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-a22c813d-555c-4f98-82e0-22eda857d494 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:27.097767 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-a22c813d-555c-4f98-82e0-22eda857d494 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:27.098608 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-a22c813d-555c-4f98-82e0-22eda857d494 admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:45:27.099027 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: DEBUG oslo_concurrency.lockutils [None req-a22c813d-555c-4f98-82e0-22eda857d494 admin admin] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109305) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:45:27.121083 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: INFO nova.api.openstack.requestlog [None req-a22c813d-555c-4f98-82e0-22eda857d494 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088231 May 09 09:45:27.121655 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: [pid: 109305|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon May 9 09:45:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:46:26.426895 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: Mon May 9 09:46:26 2022 - graceful shutdown triggered... May 09 09:46:26.426639 dv-cinder-841083-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 09 09:46:26.435357 dv-cinder-841083-1-iscsi devstack@n-api.service[109305]: Gracefully killing worker 1 (pid: 109305)... May 09 09:46:26.435964 dv-cinder-841083-1-iscsi devstack@n-api.service[109306]: Gracefully killing worker 2 (pid: 109306)... May 09 09:46:27.427627 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: worker 1 buried after 1 seconds May 09 09:46:27.427627 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: worker 2 buried after 1 seconds May 09 09:46:27.427627 dv-cinder-841083-1-iscsi devstack@n-api.service[109304]: goodbye to uWSGI. May 09 09:46:27.430082 dv-cinder-841083-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 09 09:46:27.431017 dv-cinder-841083-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 09 09:46:27.435308 dv-cinder-841083-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 09 09:46:27.457208 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 9 09:46:27 2022] *** May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: nodename: dv-cinder-841083-1-iscsi May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: machine: x86_64 May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: clock source: unix May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: pcre jit disabled May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: detected number of CPU cores: 4 May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: current working directory: / May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: detected binary path: /usr/bin/uwsgi-core May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: your processes number limit is 47680 May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: your memory page size is 4096 bytes May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: detected max file descriptor number: 2048 May 09 09:46:27.482051 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: lock engine: pthread robust mutexes May 09 09:46:27.483049 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: thunder lock: enabled May 09 09:46:27.483049 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 09 09:46:27.483049 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 09 09:46:27.527407 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: Python main interpreter initialized at 0x561d998c89c0 May 09 09:46:27.527407 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: python threads support enabled May 09 09:46:27.527407 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: your server socket listen backlog is limited to 100 connections May 09 09:46:27.527407 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: your mercy for graceful operations on workers is 90 seconds May 09 09:46:27.527830 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: mapped 403077 bytes (393 KB) for 2 cores May 09 09:46:27.527830 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: *** Operational MODE: preforking *** May 09 09:46:27.528078 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: *** uWSGI is running in multiple interpreter mode *** May 09 09:46:27.528078 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: spawned uWSGI master process (pid: 123625) May 09 09:46:27.528300 dv-cinder-841083-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 09 09:46:27.529020 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: spawned uWSGI worker 1 (pid: 123637, cores: 1) May 09 09:46:27.529289 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: spawned uWSGI worker 2 (pid: 123638, cores: 1) May 09 09:46:27.529478 dv-cinder-841083-1-iscsi devstack@n-api.service[123625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 09 09:46:28.724056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 09:46:28.724962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 09 09:46:29.506401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:46:29.506401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: from cryptography.utils import int_from_bytes May 09 09:46:29.506738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:46:29.506738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: from cryptography.utils import int_from_bytes May 09 09:46:29.506913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:46:29.506913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: from cryptography.utils import int_from_bytes May 09 09:46:29.507042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 09 09:46:29.507042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: from cryptography.utils import int_from_bytes May 09 09:46:31.930277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 09:46:31.930836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 09:46:31.930970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 09:46:31.931338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 09:46:31.931592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 09:46:31.931981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.932307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.932629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.932972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.933303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.933611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.933934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.934255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.934581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.934842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.935158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.935481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841083-1-iscsi {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.935800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.936106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.936414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.936763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.937075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.937396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.937702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.938199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.938943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.939255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.939657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.940004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.940322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.940636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.940857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 09 09:46:31.941309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.941416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 09 09:46:31.941496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.941577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.941661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 09 09:46:31.941905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.942037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 09 09:46:31.942247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 09 09:46:31.942366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841083-1-iscsi {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.942606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.942744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.942938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.943996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.944196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.944305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.944506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.944635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.944870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.944956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.945166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.945380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.945608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.945937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.946180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.946416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.946625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841083-1-iscsi {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.946864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.947041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.947235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.947421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.947569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.947756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.947930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.948089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.948246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.948398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.948583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.948762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.948909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.949083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.949242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.949242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.949540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.949700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.949906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.950094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.950251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.950406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.950575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.950731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.950891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.951970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.952114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.952266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.952419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.952573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.952757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.952916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.953062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.953206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841083-1-iscsi {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.953349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.953509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.954202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.954367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.954522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.954673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.954835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.954980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.955146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.955393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.955550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.955702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.955860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.956956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.957108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.957290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.957448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.957600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.957757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.957902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.958046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.958189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.958340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.958340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.958825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.958825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.959112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.959112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.959422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.959575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.959732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.959887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.960032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.960032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.960314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.960467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.960622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.960820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.961563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.961729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.961896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.962057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.962213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.962368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.962530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.963075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.963249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.963403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.963556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.963730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.964490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.964679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.964845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.965926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.966993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.967138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.967281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.967434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.967579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.967721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.967866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.968977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.969145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.969306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.969460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.969611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.969770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.969921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.970066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.970211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.970364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.970521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.970683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.970835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.971955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.972118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.972398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.972398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.972754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.972921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.973995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.974735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.974897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.975957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.976101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.976252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.976408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.976561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.976857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.977936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.978988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.979140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.979294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.979458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.979613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.979766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.979918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.980070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.980214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.980367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.980519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.980824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.980998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.981145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.981297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.981448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.981618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.981764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.981923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.982076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.982227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.982390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.982602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.982765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.982920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.983093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.983681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.983863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.984266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.984720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.985041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.985202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.985356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.985509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.985663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.985822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.985977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.986122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.986275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.986419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.986419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.986727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.986872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.987025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.987180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.987646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.987804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.987958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.988105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.988249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.988392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.988536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.988719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.988881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.989039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.989193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.989338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.989481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.989634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.989788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.989940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.990096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.990242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.990385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.990537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.990693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.990847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 09 09:46:31.991012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.991164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.991311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.991463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.991628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.991772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.991926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.992077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.992230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.992375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.992531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.992802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.992975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.993130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.993276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.993434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.993587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.993732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.993876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.994020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.994263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.994515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.994933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.995283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.995441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.995604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.995759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.995918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.996063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.996214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.996370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.996515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.996693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.996981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.997130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.997281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.997426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.997590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.997745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.997896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.998939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:31.999995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.000148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.000293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.000446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.000598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.000777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.000924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.001985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.002174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.002333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.002486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.002630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.002793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.003925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.004084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.004254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.004486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.005026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.005200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.005609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.005773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.005919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.006072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.006235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.006380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.006537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.006682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.009415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.009588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.009742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.009891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.010976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.011123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.011275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.011427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.011580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.011735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.011879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.012023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.012169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.012313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.012456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.012614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.012843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.013010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.013240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.013394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.013549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.013715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.013860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.014005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.014148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.014294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.014457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.014705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.015212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.015386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.015732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.015884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.016816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.017109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.017253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.017398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.017398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.017745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.017905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.018955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.019107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.019254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.019409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.019570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.019725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.019871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.020015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.020175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.020328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.020486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.020640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.020878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.021945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022090 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.022990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.023143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.023374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.023543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.023690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.023835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.023979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.024137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.024295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.024440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.024584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.024879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.025415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.025581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.025947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.026099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.026263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.026408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.026560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.026714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.026861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.027921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.028084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.028236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.028390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.028543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.028707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.028858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.029903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.030983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.031225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.031385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.031542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.031694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.031848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.031848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.032153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.032308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.032452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.032596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.032786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.032947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.033094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.033239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.033440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.033670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.033820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.033975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.034971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.035636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.035788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.036138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.036302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.036447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.036600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.036783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.036947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.037100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.037259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.037590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.037740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.037884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.038953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.039107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.039323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.039480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.039625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.039777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.039929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.040082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.040241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.040386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.040538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.040746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.040897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.041977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.042133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.042283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.042448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.042608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.042760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.042921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.043081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.043233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.043383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.043541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.043787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.043960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.044121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.044281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.044443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.044603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.044793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.044966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.045188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.045383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.045873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.046059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.046403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.046562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.046714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.046876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.047973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.048135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.048303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.048463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.048624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.048808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.048995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.049937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.050251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.050419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.050572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.050732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.050898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.051065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.051218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.051369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.051520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.051672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.051831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.052008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.052168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.052319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.052479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.052638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.052869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.053023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.053186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.053346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.053513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.053666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.053899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.054062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.054234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.054386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.054553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.054712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.054864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.055014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.055185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.055414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.055570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.056069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.056230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.056569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.056770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.056942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.057105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.057266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.057418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.057569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.057720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.057881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.058922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.059999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.060988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.061923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.062896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.063827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.064922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.065051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.065179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.065315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.065531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.065681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.066154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.066290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.066429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.066429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.066865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.067951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.068926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.069788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.070979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.071918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.072984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.073483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.073613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.073613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.073862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.074977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.075114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.075114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.075375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.075596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.075596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.076229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.076382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.076382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.076625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.077950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.078751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.079940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.080912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.081979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.082877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.083938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.084959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085472 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.085929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.086085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.086536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.086675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.086818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.086970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.086970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.087402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.087539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.087539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.087803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.087941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.087941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.088198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.088335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.088478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.088606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.088606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.088896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.089784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.090944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.091844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.092894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.093934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.095193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.095332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.095468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.095605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.095605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.095922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.096125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.096581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.096729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.096729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.097074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.097208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.097208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.097655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.097785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.097785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.098946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.099869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.100964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.101987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.102835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.104916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.105971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.106116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.106116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.106436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.106871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.106871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.107126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.107253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.107253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.107804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.107939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.108882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.109613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.109613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.109892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.110022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.110150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.110285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.110285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.110545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.110674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.111977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.112105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.112242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.112752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.112886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.112886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.113927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.114181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.114319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.114319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.114569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.114707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.114707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.116235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.116446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.116602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.117071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.117071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.117340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.117469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.117469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.118938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.119991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.120127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.120127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.120389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.120525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.120654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.121489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.121489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.121768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.121898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.122035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.122163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.122519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.122653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.122653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.122910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.123047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.123176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.123313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.123520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.124045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.124045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.124311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.124519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.124686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.124845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.125869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.126008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.126137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.126275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.126405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.126640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.126789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.127280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.127419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.127559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.127706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.127837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.128249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.128381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.128510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.128639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.128855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.128989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.129938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.130888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.131955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.132923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.133883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.134968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.135986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.136116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.136253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.136383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.136537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.136816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.136960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.137376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.137600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.137733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.137872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.138033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.138397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.138532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.138669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.138799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.138943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.139889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.140931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.141928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.142240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.142375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.142547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.142704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.142911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.143980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.144150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.144284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.144454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.144596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.144834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.144981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.145127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.145345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.145486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.145623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.145762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.145906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.146036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.146165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.146305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.146444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.146581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.146900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.147048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.147327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.148524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.148524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.148865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.149950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.150096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.150249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.150402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.150563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.150718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.150864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.151777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.152059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.152211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.152392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.152392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.153603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.153757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.153905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.154064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.154287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.154465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.154595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.154734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.154874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.155912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.156877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.157096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.157228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.157521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.157722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.157864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.158005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.158150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.158409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.158822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.158970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.159929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.160964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.161920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.162986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.163912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.164871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.165896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.166974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.167117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.167315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.167593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.167744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.167947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.168089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.168219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.168364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.168556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.168754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.169993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.170952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.171877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.172966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.173921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.174870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.175884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.176857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.177037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.177170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.177322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.177523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.177790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.177949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.178142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.178277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.178414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.178568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.178759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.178902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.179220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.179358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.179496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.179632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.179769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.179912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.180898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.181972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.182225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.182225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.182495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.183990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.184988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.185126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.185257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.185385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.185522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.185669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.185877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.186969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.187100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.187227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.187366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.187516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.187836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.187973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.188125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.188321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.188454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.188592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.188772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.188967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.189100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.189248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.189610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.189755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.189885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.190975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.191921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 09:46:32.192437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.192982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.193201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.193509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.193816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.194120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.194431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.194735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.195037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.195341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.195647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.195979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.196280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.196589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.196961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.197272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.197575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.197887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.198194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.198527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.198864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.199182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.199663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.199808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.200131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.200442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.200792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.201116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.201435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.201747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.202084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.202399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.202717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.203036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.203353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.203666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.203980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.204310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.204641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.204971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.205325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.205649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.205978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.206302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.206615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.206947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.207264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.207580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.207901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.208217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.208530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.208875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.209193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.209525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.209969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.210382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.210497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.210841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.211156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.211504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.211834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.212153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.212471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.212799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 09 09:46:32.213048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 09 09:46:32.215229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-760b3191-be36-468f-a524-b73ebec18538 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.236195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.279399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.context [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3fa34f5-2fe2-4198-819d-4854c40b59aa(cell1) {{(pid=123637) load_cells /opt/stack/nova/nova/context.py:464}} May 09 09:46:32.283894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:46:32.285498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:46:32.286305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:46:32.288228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:46:32.299661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-760b3191-be36-468f-a524-b73ebec18538 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.300949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.context [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d3fa34f5-2fe2-4198-819d-4854c40b59aa(cell1) {{(pid=123638) load_cells /opt/stack/nova/nova/context.py:464}} May 09 09:46:32.301939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-760b3191-be36-468f-a524-b73ebec18538 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.305416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:46:32.307036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:46:32.307851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:46:32.309870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:46:32.321709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.323087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.462890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_db.sqlalchemy.engines [None req-760b3191-be36-468f-a524-b73ebec18538 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.481614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_db.sqlalchemy.engines [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 09 09:46:32.786362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-760b3191-be36-468f-a524-b73ebec18538 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:46:32.793974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:46:32.799385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:46:32.806881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:46:33.138796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-760b3191-be36-468f-a524-b73ebec18538 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:46:33.145170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: WARNING keystonemiddleware.auth_token [None req-760b3191-be36-468f-a524-b73ebec18538 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:46:33.149810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 09 09:46:33.150555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d998c89c0 pid: 123637 (default app) May 09 09:46:33.156036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: WARNING keystonemiddleware.auth_token [None req-0b180162-ce5c-4c25-ba5b-4fad1a08b096 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 09 09:46:33.161445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d998c89c0 pid: 123638 (default app) May 09 09:47:16.041598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7dcea8f8-01b4-4c7f-817e-643c1b3ae9f7 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Action: 'create', calling method: .version_select at 0x7fa464e2c280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-169522562", "metadata": {"Type": "work"}}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7dcea8f8-01b4-4c7f-817e-643c1b3ae9f7 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Request method failure captured: May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 121 May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMiJUKcrwb4JKhnH8fDc-Cc0oioE32yw1Zh8PnmKclT9YZIGsmBUuPX4BR87LSYk8AQ5f27_pEVdsX6WSC6p_glulp4JNcZZqN2GwgLb1uhIIS4GR-1scRLaxuUdeAoBh4qYxbumwzfpCZRFyNVu5fBPzKEAfIVld04pQEq4PqlZBc May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:47:16.061692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccaa0efe9f4d44d8899fabe0d5ed3d86", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesNegativeTest-673178870-project May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 31fb080fb94046f8bc64575c367f5ec8 May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesNegativeTest-673178870-project May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-169522562", "metadata": {"Type": "work"}}} May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: May 09 09:47:16.063143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-169522562', 'metadata': {'Type': 'work'}}}} May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise error May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi '#$%' May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:47:16.064036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 09:47:16.065502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 09:47:16.066683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 09 09:47:16.066683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.066683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7dcea8f8-01b4-4c7f-817e-643c1b3ae9f7 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:47:16.066683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7dcea8f8-01b4-4c7f-817e-643c1b3ae9f7 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.679819 May 09 09:47:16.066683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Mon May 9 09:47:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1682 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 09:47:16.575766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00e1f10b-c4cb-482b-b4ce-63a7958b8eb2 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Action: 'create', calling method: .version_select at 0x7fa464e55ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-611356375", "metadata": {"Type": "work"}}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00e1f10b-c4cb-482b-b4ce-63a7958b8eb2 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Request method failure captured: May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 119 May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMiJUKcrwb4JKhnH8fDc-Cc0oioE32yw1Zh8PnmKclT9YZIGsmBUuPX4BR87LSYk8AQ5f27_pEVdsX6WSC6p_glulp4JNcZZqN2GwgLb1uhIIS4GR-1scRLaxuUdeAoBh4qYxbumwzfpCZRFyNVu5fBPzKEAfIVld04pQEq4PqlZBc May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:47:16.582115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccaa0efe9f4d44d8899fabe0d5ed3d86", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesNegativeTest-673178870-project May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 31fb080fb94046f8bc64575c367f5ec8 May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesNegativeTest-673178870-project May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-611356375", "metadata": {"Type": "work"}}} May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 09:47:16.583795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-611356375', 'metadata': {'Type': 'work'}}}} May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise error May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi '0' May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:47:16.584614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 09:47:16.587024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 09:47:16.589740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 09 09:47:16.589740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:16.591818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00e1f10b-c4cb-482b-b4ce-63a7958b8eb2 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:47:16.593205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00e1f10b-c4cb-482b-b4ce-63a7958b8eb2 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.520720 May 09 09:47:16.607526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c296588f-e586-4344-8ab2-6ef33f72aaff tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Action: 'create', calling method: .version_select at 0x7fa464cd05e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-519673479", "metadata": {"Type": "work"}}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c296588f-e586-4344-8ab2-6ef33f72aaff tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Request method failure captured: May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 118 May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMiJUKcrwb4JKhnH8fDc-Cc0oioE32yw1Zh8PnmKclT9YZIGsmBUuPX4BR87LSYk8AQ5f27_pEVdsX6WSC6p_glulp4JNcZZqN2GwgLb1uhIIS4GR-1scRLaxuUdeAoBh4qYxbumwzfpCZRFyNVu5fBPzKEAfIVld04pQEq4PqlZBc May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:47:16.611183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccaa0efe9f4d44d8899fabe0d5ed3d86", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesNegativeTest-673178870-project May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 31fb080fb94046f8bc64575c367f5ec8 May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesNegativeTest-673178870-project May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-519673479", "metadata": {"Type": "work"}}} May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: May 09 09:47:16.613268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-519673479', 'metadata': {'Type': 'work'}}}} May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise error May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi On instance['volume']: May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi '' May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:47:16.614673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 09 09:47:16.615992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 09 09:47:16.617105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 09 09:47:16.617105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:47:16.617246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Mon May 9 09:47:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 09:47:16.618923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c296588f-e586-4344-8ab2-6ef33f72aaff tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:47:16.620031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c296588f-e586-4344-8ab2-6ef33f72aaff tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018363 May 09 09:47:16.626090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1155 bytes} [Mon May 9 09:47:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 09:47:16.631835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3343eb8d-6760-4bfa-8378-0e3268252f8a tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Calling method '.version_select at 0x7fa464d181f0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:17.086389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-913371254", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "networks": [{"uuid": "e77e0d65-c7af-4711-8fa7-19ff4addcdcc"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:17.672448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] validate_networks() for [('e77e0d65-c7af-4711-8fa7-19ff4addcdcc', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:47:17.966923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-3343eb8d-6760-4bfa-8378-0e3268252f8a tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] HTTP exception thrown: Volume tempest-invalid-565413582 could not be found. May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3343eb8d-6760-4bfa-8378-0e3268252f8a tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Request method failure captured: May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-565413582 HTTP/1.1 May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMiJUKcrwb4JKhnH8fDc-Cc0oioE32yw1Zh8PnmKclT9YZIGsmBUuPX4BR87LSYk8AQ5f27_pEVdsX6WSC6p_glulp4JNcZZqN2GwgLb1uhIIS4GR-1scRLaxuUdeAoBh4qYxbumwzfpCZRFyNVu5fBPzKEAfIVld04pQEq4PqlZBc May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:47:17.971843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccaa0efe9f4d44d8899fabe0d5ed3d86", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesNegativeTest-673178870 May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesNegativeTest-673178870-project May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 31fb080fb94046f8bc64575c367f5ec8 May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesNegativeTest-673178870-project May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Volume tempest-invalid-565413582 could not be found. May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'tempest-invalid-565413582'} May 09 09:47:17.973398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-565413582 could not be found. (HTTP 404) (Request-ID: req-5b3bb4a8-17a2-48dc-96b5-f7085d4bcc8e) May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:17.974233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 09:47:17.975527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-565413582 could not be found. May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:47:17.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-565413582 could not be found. May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-565413582 could not be found. May 09 09:47:17.977884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:17.980326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3343eb8d-6760-4bfa-8378-0e3268252f8a tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Returning 404 to user: Volume tempest-invalid-565413582 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:47:17.982006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3343eb8d-6760-4bfa-8378-0e3268252f8a tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-565413582" status: 404 len: 98 microversion: 2.1 time: 1.354777 May 09 09:47:17.983302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1214 bytes} [Mon May 9 09:47:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-565413582 => generated 98 bytes in 1358 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 09 09:47:18.001089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c530b288-eabc-4ba0-92a7-5d343936cca8 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009259 May 09 09:47:18.009568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1139 bytes} [Mon May 9 09:47:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 09:47:18.023795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bd4daaf2-9e75-42e9-93ab-35765cfe841b tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012778 May 09 09:47:18.029980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 4/6] 10.222.0.26 () {58 vars in 1136 bytes} [Mon May 9 09:47:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 09 09:47:18.039174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08fd555b-3fff-45b7-8e16-b8d6e86d3d94 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Calling method '.version_select at 0x7fa464c60ee0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:18.193694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-08fd555b-3fff-45b7-8e16-b8d6e86d3d94 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] HTTP exception thrown: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08fd555b-3fff-45b7-8e16-b8d6e86d3d94 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Request method failure captured: May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/os-volumes/b64eb06a-eb57-4db2-8ba3-56b5708f022d HTTP/1.1 May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMiJUKcrwb4JKhnH8fDc-Cc0oioE32yw1Zh8PnmKclT9YZIGsmBUuPX4BR87LSYk8AQ5f27_pEVdsX6WSC6p_glulp4JNcZZqN2GwgLb1uhIIS4GR-1scRLaxuUdeAoBh4qYxbumwzfpCZRFyNVu5fBPzKEAfIVld04pQEq4PqlZBc May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:47:18.199280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccaa0efe9f4d44d8899fabe0d5ed3d86", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesNegativeTest-673178870 May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesNegativeTest-673178870-project May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 31fb080fb94046f8bc64575c367f5ec8 May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesNegativeTest-673178870-project May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'b64eb06a-eb57-4db2-8ba3-56b5708f022d'} May 09 09:47:18.200585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. (HTTP 404) (Request-ID: req-e0fb6301-bae8-48b4-b1f8-635e2c1d3c66) May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:18.201487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 09:47:18.202689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 09:47:18.203882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08fd555b-3fff-45b7-8e16-b8d6e86d3d94 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Returning 404 to user: Volume b64eb06a-eb57-4db2-8ba3-56b5708f022d could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-08fd555b-3fff-45b7-8e16-b8d6e86d3d94 tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/b64eb06a-eb57-4db2-8ba3-56b5708f022d" status: 404 len: 109 microversion: 2.1 time: 0.167562 May 09 09:47:18.205287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 5/7] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 09:47:18 2022] DELETE /compute/v2.1/os-volumes/b64eb06a-eb57-4db2-8ba3-56b5708f022d => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 09:47:18.214858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d6791bb-4f95-438c-b9ef-92c48e46be8f tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Calling method '.version_select at 0x7fa464c021f0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:18.311552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-5d6791bb-4f95-438c-b9ef-92c48e46be8f tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] HTTP exception thrown: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d6791bb-4f95-438c-b9ef-92c48e46be8f tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Request method failure captured: May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/os-volumes/ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb HTTP/1.1 May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMiJUKcrwb4JKhnH8fDc-Cc0oioE32yw1Zh8PnmKclT9YZIGsmBUuPX4BR87LSYk8AQ5f27_pEVdsX6WSC6p_glulp4JNcZZqN2GwgLb1uhIIS4GR-1scRLaxuUdeAoBh4qYxbumwzfpCZRFyNVu5fBPzKEAfIVld04pQEq4PqlZBc May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:47:18.313552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ccaa0efe9f4d44d8899fabe0d5ed3d86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ccaa0efe9f4d44d8899fabe0d5ed3d86", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesNegativeTest-673178870 May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: ccaa0efe9f4d44d8899fabe0d5ed3d86 May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesNegativeTest-673178870 May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesNegativeTest-673178870-project May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 31fb080fb94046f8bc64575c367f5ec8 May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesNegativeTest-673178870-project May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb'} May 09 09:47:18.314869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. (HTTP 404) (Request-ID: req-d1ed4ab8-f8d6-41d4-b907-991d07090faa) May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:18.315768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:47:18.316964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 09:47:18.318079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d6791bb-4f95-438c-b9ef-92c48e46be8f tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] Returning 404 to user: Volume ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5d6791bb-4f95-438c-b9ef-92c48e46be8f tempest-VolumesNegativeTest-673178870 tempest-VolumesNegativeTest-673178870-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb" status: 404 len: 109 microversion: 2.1 time: 0.104916 May 09 09:47:18.319207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 6/8] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:47:18 2022] GET /compute/v2.1/os-volumes/ad3ed37d-cf6b-42bb-8c02-5e2b7e4e1cbb => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:47:20.094086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:47:20.095760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:47:20.096387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:47:20.096928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:47:20.097446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:47:20.114248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:20.115147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:20.116247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:20.117025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:20.156288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Getting quotas for project 153cae04bb6b46d0a52c15411f0c4720. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:20.166385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Getting quotas for user 40cb55020f07488c9c344541d895ec1c and project 153cae04bb6b46d0a52c15411f0c4720. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:20.198382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:47:20.205418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:47:20.363132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d43b971d-9fa0-4464-8f65-e3fd1a83d8c8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.576478 May 09 09:47:20.363875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 3/9] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:47:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:47:20.375904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ebe57f0c-8962-4b10-b55e-6a39bef00a1a tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:20.376795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ebe57f0c-8962-4b10-b55e-6a39bef00a1a tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:21.154167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebe57f0c-8962-4b10-b55e-6a39bef00a1a tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:21.179338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ebe57f0c-8962-4b10-b55e-6a39bef00a1a tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1214 microversion: 2.1 time: 0.808257 May 09 09:47:21.185826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 7/10] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:20 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1214 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:22.203490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:22.204114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:22.258051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:22.258502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:22.259422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:22.259709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:22.749517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:22.780806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22bcaec6-5292-4a14-8683-f22a4e560ada tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1218 microversion: 2.1 time: 0.582421 May 09 09:47:22.784976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 4/11] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:22 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1218 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:23.799492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:23.800525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:23.821870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:23.822316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:23.831537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:23.832075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:24.559654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:24.591248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6be448b8-e346-4a20-a937-b0907f87088b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1218 microversion: 2.1 time: 0.795658 May 09 09:47:24.594340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 8/12] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:23 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1218 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:24.853873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e7b60d0-8fa9-4b49-aa6c-00c035a4c024 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'create', calling method: .version_select at 0x7fa46436c940>, body: {"keypair": {"name": "tempest-keypair-941138886"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:24.917853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4e7b60d0-8fa9-4b49-aa6c-00c035a4c024 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:24.926990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4e7b60d0-8fa9-4b49-aa6c-00c035a4c024 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for user 76dc34045544496ab030864c5a0ffbff and project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:25.397890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4e7b60d0-8fa9-4b49-aa6c-00c035a4c024 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:25.412710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4e7b60d0-8fa9-4b49-aa6c-00c035a4c024 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for user 76dc34045544496ab030864c5a0ffbff and project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:25.462296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e7b60d0-8fa9-4b49-aa6c-00c035a4c024 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.093903 May 09 09:47:25.464998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 5/13] 10.222.0.26 () {62 vars in 1198 bytes} [Mon May 9 09:47:24 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1097 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) May 09 09:47:25.618290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:25.618812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:25.645271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:25.647732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:25.650427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:25.652867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:25.917449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:25.931758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-251d6ae0-03de-412a-80d1-a5ef87100c27 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1218 microversion: 2.1 time: 0.323567 May 09 09:47:25.932801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 9/14] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:25 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1218 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:26.950827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:26.951500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:26.964300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:26.964791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:26.973719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:26.974326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:27.187144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:27.195710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ff4429c-2913-490c-8128-fc1cc16f82ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1266 microversion: 2.1 time: 0.249043 May 09 09:47:27.204390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 6/15] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:26 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:28.222115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:28.225476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:28.236768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:28.239576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:28.239576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:28.239576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:28.449161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:28.462914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43218030-86cf-43e8-ad66-8dd874ecd3b2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1266 microversion: 2.1 time: 0.245741 May 09 09:47:28.463494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 10/16] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:28 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:28.754053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1344374161", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5d2e451-c229-4fa8-9496-a76796ccc192"}], "security_groups": [{"name": "tempest-securitygroup--146802850"}], "key_name": "tempest-keypair-941138886", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:28.936115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1223371102", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:29.059170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] validate_networks() for [('a5db3e70-fbca-49f7-aa77-27bb8754df68', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:47:29.185937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] validate_networks() for [('a5d2e451-c229-4fa8-9496-a76796ccc192', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:47:30.043135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:47:30.046535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:47:30.047364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:47:30.047927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:47:30.048496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:47:30.084618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:30.085927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:30.087464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:30.087913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:30.120608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:30.124863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for user e58c14dca7da4e6495f7e08f2bb127e2 and project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:30.145393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:47:30.148211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:47:30.299836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f63e7540-c52d-46d6-acf4-b0dd1dc72152 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.710720 May 09 09:47:30.305556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 7/17] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:47:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:47:30.498783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e325c1c-f1f7-4c45-a4b2-a4caa1edbb73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: .version_select at 0x7fa4642faa60>, body: {"keypair": {"name": "tempest-keypair-1208652429"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:30.546550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6e325c1c-f1f7-4c45-a4b2-a4caa1edbb73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:30.562478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6e325c1c-f1f7-4c45-a4b2-a4caa1edbb73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for user f89c5ab1020947a9bece03af4c237480 and project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:30.921602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6e325c1c-f1f7-4c45-a4b2-a4caa1edbb73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:30.931859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6e325c1c-f1f7-4c45-a4b2-a4caa1edbb73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for user f89c5ab1020947a9bece03af4c237480 and project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:30.972547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e325c1c-f1f7-4c45-a4b2-a4caa1edbb73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.670472 May 09 09:47:30.973516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 8/18] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 09:47:30 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:30.992373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:30.993261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:31.005767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:31.006302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:31.007159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:31.009256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:31.235287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:31.248869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3f28806-c954-4951-badc-78caab269ae1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1272 microversion: 2.1 time: 0.273224 May 09 09:47:31.251292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 9/19] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:30 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:31.264881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc9fcaf5-5025-4f09-9564-369cf9103408 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:31.266175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc9fcaf5-5025-4f09-9564-369cf9103408 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:31.467789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:47:31.468254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:47:31.468936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:47:31.469349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:47:31.469756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:47:31.525212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:31.534482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:31.535405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:31.535844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:31.611495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:31.619463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for user 76dc34045544496ab030864c5a0ffbff and project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:31.640142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:47:31.644145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:47:31.694284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc9fcaf5-5025-4f09-9564-369cf9103408 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:31.743734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc9fcaf5-5025-4f09-9564-369cf9103408 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1222 microversion: 2.1 time: 0.490546 May 09 09:47:31.751757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:31 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1222 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:31.874297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1df5b3b1-9034-4b3d-9809-fb90caf1f632 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.150909 May 09 09:47:31.878024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 11/21] 10.222.0.26 () {62 vars in 1187 bytes} [Mon May 9 09:47:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 3158 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 09:47:31.889522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0a0d480-63a0-4851-af21-3cc9a45f84c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:31.890134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e0a0d480-63a0-4851-af21-3cc9a45f84c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:32.128531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0a0d480-63a0-4851-af21-3cc9a45f84c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:32.140241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0a0d480-63a0-4851-af21-3cc9a45f84c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:32.143771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0a0d480-63a0-4851-af21-3cc9a45f84c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:32.146224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0a0d480-63a0-4851-af21-3cc9a45f84c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1281 microversion: 2.20 time: 0.260786 May 09 09:47:32.147039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 11/22] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:32.175313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2136509150", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:32.268642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:32.269385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:32.289472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:32.292938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:32.296617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:32.310203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:32.380199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] validate_networks() for [('a5db3e70-fbca-49f7-aa77-27bb8754df68', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:47:32.635743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:32.644134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-134b7e2b-6f1d-40a0-8559-0bad611d83fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1272 microversion: 2.1 time: 0.379840 May 09 09:47:32.656604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:32 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:33.165245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15d804bd-3d9e-45e0-9ee3-32bc97e1c192 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:33.166517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15d804bd-3d9e-45e0-9ee3-32bc97e1c192 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:33.580808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15d804bd-3d9e-45e0-9ee3-32bc97e1c192 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:33.591682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15d804bd-3d9e-45e0-9ee3-32bc97e1c192 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:33.596912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15d804bd-3d9e-45e0-9ee3-32bc97e1c192 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:33.598339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15d804bd-3d9e-45e0-9ee3-32bc97e1c192 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1281 microversion: 2.20 time: 0.437417 May 09 09:47:33.623575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 13/24] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1281 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:33.661346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:33.661967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:33.671553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:33.672065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:33.673008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:33.673452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:34.071130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:34.088526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d310335-7cf5-4067-b12c-522b8d4764f7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.429901 May 09 09:47:34.104700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:33 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:47:34.289449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:47:34.290062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:47:34.290311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:47:34.294608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:47:34.295042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:47:34.307438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:34.307923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:34.309113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:34.309655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:34.331204 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:34.335380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for user e58c14dca7da4e6495f7e08f2bb127e2 and project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:34.352466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:47:34.355002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:47:34.472309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e940e93-ffeb-4813-9570-67ac2d369b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.304686 May 09 09:47:34.479967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 12/26] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:47:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:47:34.485266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab07995c-0de8-462b-ab5a-320e926b2229 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:34.485970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab07995c-0de8-462b-ab5a-320e926b2229 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:34.619076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:34.619688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:34.638893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:34.648977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:34.649948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:34.650398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:34.828717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:34.838440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:34.846983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:34.847469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab07995c-0de8-462b-ab5a-320e926b2229 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:34.848147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-67d9336b-98d4-4b9e-b63f-a4b63eac87b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1285 microversion: 2.20 time: 0.233463 May 09 09:47:34.849898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 13/27] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:34.871763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab07995c-0de8-462b-ab5a-320e926b2229 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1222 microversion: 2.1 time: 0.390337 May 09 09:47:34.881211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 15/28] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:34 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1222 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:35.108729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:35.109820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:35.142408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:35.149111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:35.156969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:35.158595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:35.646956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:35.666111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-232e7b80-a741-47b0-9d4d-effb00766c46 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.560509 May 09 09:47:35.669088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:35 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:35.875986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:35.876766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:35.888428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:35.888813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:35.891922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:35.892372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:35.893450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:35.894339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:35.905923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:35.906942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:35.907973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:35.909425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:36.117334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:36.139169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb4a1dbe-23da-465c-882f-4a28f0938a3e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1218 microversion: 2.1 time: 0.250755 May 09 09:47:36.154394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:35 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:36.200005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:36.215863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:36.229627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:36.232291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d663a91-8653-4eec-84c3-e9da867065d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1277 microversion: 2.20 time: 0.368323 May 09 09:47:36.233921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1277 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:36.688859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:36.689975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:36.703068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:36.708064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:36.709255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:36.710777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:36.805935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-304781697", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a20fcc2-3cfd-4768-9099-0b113691749f"}], "security_groups": [{"name": "tempest-securitygroup--1851408968"}], "key_name": "tempest-keypair-1208652429", "user_data": "}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:37.010758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] validate_networks() for [('6a20fcc2-3cfd-4768-9099-0b113691749f', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:47:37.078305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:37.096474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-571915f1-ea5f-4924-abae-a21dfdfd6c52 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.413813 May 09 09:47:37.097668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:36 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:37.160114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:37.161220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:37.172247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:37.172912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:37.173860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:37.174582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:37.373855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:37.384443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d7518962-a718-4630-822b-f73e1b50b43a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1218 microversion: 2.1 time: 0.228506 May 09 09:47:37.394459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:37 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:47:37.419374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:37.420963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:37.446749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:37.449853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:37.450965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:37.453900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:37.669526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:37.690792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:37.695877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:37.697247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-50636ec0-7a26-4278-8068-e81adc025e31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.293357 May 09 09:47:37.709249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 18/34] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:38.119600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:38.120549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:38.145687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.146511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.150437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.151092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.446622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:38.459746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94eb907d-59c7-457c-9b99-05832db54c49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.349551 May 09 09:47:38.471323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 19/35] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:38 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:38.493927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:38.494887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:38.522061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.522061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.522061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.522061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.687078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:38.705526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f453d9f-b8af-424e-842a-a27f8676547b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.232750 May 09 09:47:38.715970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 20/36] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:38 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:38.733815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:38.735963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:38.748977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.750878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.754180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.754793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.837834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:47:38.838460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:47:38.838810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:47:38.839124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:47:38.839549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:47:38.857299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.857745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.858547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:38.859020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:38.921507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:47:38.936105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for user f89c5ab1020947a9bece03af4c237480 and project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:47:38.989044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:47:38.991224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:47:39.010671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:39.020492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:39.027780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:39.029300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ebcd3777-704c-458f-b1df-7878d9da54e6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.308887 May 09 09:47:39.030553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 21/37] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:39.116219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-81ad6c50-2f96-405e-bc03-bb7ff5e5e018 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.343412 May 09 09:47:39.118197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 17/38] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:47:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:47:39.130782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-12ed1e55-7155-4011-94c8-308bfc1941e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:39.131587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-12ed1e55-7155-4011-94c8-308bfc1941e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:39.347068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-12ed1e55-7155-4011-94c8-308bfc1941e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:39.356494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-12ed1e55-7155-4011-94c8-308bfc1941e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1237 microversion: 2.1 time: 0.231750 May 09 09:47:39.361380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 22/39] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1237 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:39.498230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:39.500620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:39.531496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:39.534496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:39.539293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:39.548848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:39.897459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:39.910198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6efffd2-b7d4-4592-880a-4484c9fcd4ad tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.437054 May 09 09:47:39.916243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 18/40] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:39 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:39.925735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-c9f64272-1662-4881-8d55-d11bc9c90ced req-5e165a50-c650-463f-9036-f6ed99464d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84adda1-a8c2-4797-8f59-a9a2d21eb25b", "tag": "125310e8-6b4c-43ae-8571-626698644e8d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:39.946002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:39.949234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c9f64272-1662-4881-8d55-d11bc9c90ced req-5e165a50-c650-463f-9036-f6ed99464d61 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:39.949704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:39.956779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c9f64272-1662-4881-8d55-d11bc9c90ced req-5e165a50-c650-463f-9036-f6ed99464d61 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:39.968574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:39.974316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:39.976017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:39.976460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.010459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-c9f64272-1662-4881-8d55-d11bc9c90ced req-5e165a50-c650-463f-9036-f6ed99464d61 service nova] Creating event network-changed:125310e8-6b4c-43ae-8571-626698644e8d for instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b on hv-cinder-84108 May 09 09:47:40.011192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c9f64272-1662-4881-8d55-d11bc9c90ced req-5e165a50-c650-463f-9036-f6ed99464d61 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 09:47:40.016541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.020283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.022223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.024959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.082047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.compute.rpcapi [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 09:47:40.082958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] Releasing lock "compute-rpcapi-router" {{(pid=123638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 09:47:40.127583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4ab7d01-8c36-4de5-bc31-7a7eec938bcc None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.420648 May 09 09:47:40.128978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 23/41] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:47:40.134380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:40.148308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:40.162482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.169351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.170416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.171053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.196278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:40.205645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20726e6e-6457-4dd4-8685-14114c14cfe7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.288099 May 09 09:47:40.216128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 19/42] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:39 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:40.287793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:40.296972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:40.306729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:40.308300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0a3347ce-c8fc-404d-a9b9-2578017049e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.178061 May 09 09:47:40.310604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 24/43] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:40.378268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:40.379898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:40.402581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.405055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.407255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.413585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.531477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:40.546409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0419f43-17bd-4396-8c23-7146f978d20f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.165049 May 09 09:47:40.555658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 20/44] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:40.930397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:40.936384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:40.945347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.946073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:40.947293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:40.948181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.143749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:41.152523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2de94a9c-b953-41cb-872a-67367a375906 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.227294 May 09 09:47:41.153284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 25/45] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:40 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:41.222967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:41.223583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:41.230046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:41.230735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.231741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:41.232330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.300026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:41.307828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7ef9d0d-0f59-401b-a093-5cac9589102b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.088821 May 09 09:47:41.308928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 21/46] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:41 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:41.329536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:41.330143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:41.337504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:41.338106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.339065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:41.339856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.426942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:41.435966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:41.438229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:41.439413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c6589a5-cfe6-4d8b-8c8c-8fa02dff86c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.114755 May 09 09:47:41.439969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 26/47] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:41.563008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:41.565099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:41.574589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:41.575037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.575810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:41.576237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:41.656115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:41.666460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99f74afa-f25d-43fa-8571-90c085f3e2da tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.107303 May 09 09:47:41.667605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 22/48] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:42.169164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:42.169772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:42.176126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.176579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.177446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.177883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.325341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:42.327096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:42.334025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.334819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.335663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.336162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.377116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:42.385805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64c0a28b-47d9-412d-80d9-8fcee21f90c2 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.220373 May 09 09:47:42.388168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 27/49] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:42 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:42.433397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:42.442360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1842b174-44f7-48d0-8ac6-f3cd4580b8df tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.121097 May 09 09:47:42.443396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 23/50] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:42 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:42.458779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:42.459525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:42.472369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.473465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.475996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.477726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.580061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:42.590537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:42.592039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:42.593441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed874fbc-626c-4bd3-aca9-2fcf4522fc5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.139401 May 09 09:47:42.594463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 28/51] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:42.684191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:42.684862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:42.694101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.694569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.695564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:42.697249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:42.772252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:42.781886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9f64ef7f-f2da-4f49-be30-d1e71d0ae7fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.101616 May 09 09:47:42.794360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 24/52] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:43.408372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:43.409155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:43.419694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.420348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.421362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.421939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.459402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:43.460575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:43.467912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.468582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.469647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.470220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.616633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:43.634872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f27e6590-f178-4afa-ae06-e9fc519816fd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.179348 May 09 09:47:43.635459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 25/53] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:43 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:43.640161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:43.645983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:43.663480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.667224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.668280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.668921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.682692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:43.692383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb8fd90a-0efe-46f7-a43e-fdcb242611f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.288238 May 09 09:47:43.695834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 29/54] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:43 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:43.773128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:43.781368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:43.783123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:43.784569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e08e7a0d-1781-4b78-9ddd-ae09ce7d915f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.148072 May 09 09:47:43.785211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 26/55] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:43.804265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:43.805172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:43.816855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.820427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.822051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:43.822648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:43.966171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:43.975104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ffaefca-dc3b-4f7b-b60d-e47291d73ae1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.176100 May 09 09:47:43.976474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 30/56] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:44.651267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:44.652560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:44.658947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:44.659399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:44.660181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:44.660620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:44.712243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:44.713735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:44.720516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:44.721322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:44.722500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:44.725065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:44.727060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:44.736336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b189e9f8-b031-46cb-97f0-83ecebc0f1b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.088335 May 09 09:47:44.737298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 27/57] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:44 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:44.807664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:44.808264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:44.817529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:44.820152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:44.821046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:44.821495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:44.907992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:44.909610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:44.917312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:44.917527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4be32b9c-0313-4640-bafa-d9d5c76d4a03 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.209344 May 09 09:47:44.918865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:44.919257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 31/58] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:44 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:47:44.920109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e74f4221-3700-4112-af5e-5e8f3b73aa60 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.116734 May 09 09:47:44.920684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 28/59] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:44.994667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:44.995288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:45.001500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.001979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.002789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.003221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.063743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:45.071220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f083a81-5db9-46e9-a974-2e4e47d492fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.080847 May 09 09:47:45.071793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 32/60] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:45.754731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:45.755315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:45.761686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.762130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.762882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.763308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.823633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:45.833076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b31570db-a772-4504-872b-c24960340203 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.082012 May 09 09:47:45.834325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 29/61] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:45 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:45.935685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:45.937264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:45.938864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:45.939636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:45.944414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.945642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.946777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.947461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.949510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.950145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:45.951209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:45.951782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:46.047738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:46.055126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:46.057124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:46.058582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e3ef243f-d647-4c35-b06e-e09156baa538 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.124363 May 09 09:47:46.059200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 30/62] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:46.096470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:46.097337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:46.104440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:46.105241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:46.106259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:46.106691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:46.160574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:46.175441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10efb110-137d-4fb7-bb2d-46275501c9f9 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.243932 May 09 09:47:46.176515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 33/63] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:45 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:46.196634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:46.210960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6acae41e-9be0-4967-b4b9-d5d885b7f72e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.127075 May 09 09:47:46.212698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 31/64] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:47:46.850041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:46.850675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:46.857294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:46.857740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:46.858616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:46.859042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:46.927855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:46.935600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-48242fee-a8ff-4331-9ce1-86ba686ee962 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.089461 May 09 09:47:46.936184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 34/65] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:46 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:47.077337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:47.077982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:47.084370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.084847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.085612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.086043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.163164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:47.171329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:47.173125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:47.174459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-85fc0286-4abd-4eab-bd9b-f63067dcf78e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.101181 May 09 09:47:47.175119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 32/66] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:47.193988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:47.194668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:47.201083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.201767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.203271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.203779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.227466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:47.228495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:47.234721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.235173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.236272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.236730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.314321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:47.324000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a88a533-a174-41af-9d04-e1ea4ead38e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.100355 May 09 09:47:47.328731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 33/67] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:47.343578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:47.350990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9278e4a-ce13-46c1-bce8-b7a428b60396 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.161224 May 09 09:47:47.351554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 35/68] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:47 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:47.956453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:47.961299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:47.968499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.969049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:47.969794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:47.970257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.045103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:48.055429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-614aba3b-aea4-4b3e-8cf5-4789dafaf74e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1274 microversion: 2.1 time: 0.105210 May 09 09:47:48.056176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:47 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:48.192944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:48.193554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:48.199897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:48.200342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.201152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:48.201586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.265319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:48.274693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:48.276417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:48.277646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-157cbb12-e659-43eb-bd2a-b9cbcdf01b17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1333 microversion: 2.20 time: 0.088661 May 09 09:47:48.278256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:48.340429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:48.341164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:48.346988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:48.347465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.348203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:48.348621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.368202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:48.368860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:48.375268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:48.375992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.376927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:48.377469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:48.578414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:48.589593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-022309ff-db3d-4615-930e-af402bbc6bb0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1241 microversion: 2.1 time: 0.252950 May 09 09:47:48.591293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 35/71] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1241 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:48.788308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:48.800159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-75cdd55f-706d-4f12-b321-2389979c5bb4 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.435830 May 09 09:47:48.809283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 37/72] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:48 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:49.074093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:49.083013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:49.107416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.112611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.121757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.122206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.239636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:49.248293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ad1b01e8-71b5-41a1-975d-6423e1c5690a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1282 microversion: 2.1 time: 0.177996 May 09 09:47:49.258520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 36/73] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:49 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:49.298607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:49.300133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:49.307997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.308617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.309606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.310443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.529220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:49.538068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:49.539657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:49.541081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dc7e88eb-238b-4b69-9007-f82239712e06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1339 microversion: 2.20 time: 0.247512 May 09 09:47:49.541859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:49.606622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:49.607232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:49.613667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.614066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.614995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.615645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.719803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:49.730819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a11fa694-e8a6-42f7-9b80-70f52faf43b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1289 microversion: 2.1 time: 0.127863 May 09 09:47:49.741913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 37/75] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1289 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:49.817627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:49.818358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:49.825956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.826480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:49.827580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:49.828255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.009469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:50.017735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c36a7d6-7b07-4065-9310-6fc592380e56 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.205025 May 09 09:47:50.018469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 39/76] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:49 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:50.265226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:50.265850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:50.272122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:50.272681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.273470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:50.273894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.337544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:50.345131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e537c4da-704c-408b-8f9c-351bb781a71b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1282 microversion: 2.1 time: 0.083676 May 09 09:47:50.345678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 38/77] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:50 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:50.560435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:50.561084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:50.567663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:50.568028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.568835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:50.569262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.630942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:50.638629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:50.640246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:50.641364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49b45774-9ad7-444f-8030-8cd97afb3193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1339 microversion: 2.20 time: 0.084943 May 09 09:47:50.641915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 40/78] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:50.748755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:50.749487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:50.755509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:50.755958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.756715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:50.757154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:50.822168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:50.829782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56c56128-7466-40e6-97c7-ef4b28ace2c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1289 microversion: 2.1 time: 0.084949 May 09 09:47:50.830336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 39/79] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:51.035484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:51.036224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:51.042504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.043070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.043908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.044414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.183596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:51.192093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e910007-87d1-4498-b394-ea84c28d3c09 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.160481 May 09 09:47:51.192686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 41/80] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:51 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:51.362986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:51.363531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:51.369391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.369908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.370596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.371036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.431920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:51.439620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bce8777b-f932-425b-9e7a-0c89535ccfd2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1282 microversion: 2.1 time: 0.081509 May 09 09:47:51.440185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 40/81] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:51 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:51.660002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:51.660608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:51.666648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.667093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.667858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.668291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.730798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:51.740533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:51.742176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:51.743295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cdd0776c-b1ab-4bbc-afcc-31d765f44a09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1339 microversion: 2.20 time: 0.087714 May 09 09:47:51.743854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 42/82] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:51.847078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:51.848432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:51.855872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.856318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.857132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:51.857559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:51.925193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:51.932433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbd6b147-6aa6-492f-839a-bfeeb81656eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1289 microversion: 2.1 time: 0.089288 May 09 09:47:51.933036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 41/83] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:52.211053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:52.211772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:52.218544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.218992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.219751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.220179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.348244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:52.355686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d448799b-c6d4-4b83-903c-3b97d11b9400 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.148549 May 09 09:47:52.356277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:52 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:52.455496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:52.456107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:52.462041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.462509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.463258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.463688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.523013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:52.530511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-933a76ed-620f-4d47-b7d3-4d7afd7b69aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1282 microversion: 2.1 time: 0.078832 May 09 09:47:52.531147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 42/85] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:52 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:52.761938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:52.762629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:52.769647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.770222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.771232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.771673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.838620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:52.846407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:52.847756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:52.848871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e751228-9ebd-4597-b7fe-1fbd950542e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1339 microversion: 2.20 time: 0.091126 May 09 09:47:52.849425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 44/86] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:52.949608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:52.950272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:52.956331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.956805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:52.957562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:52.957985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.020639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:53.028638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f836ac81-719c-4a2e-9ff3-3b8574bfb5a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1289 microversion: 2.1 time: 0.082804 May 09 09:47:53.033105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 43/87] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:53.373142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:53.374158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:53.381155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:53.381908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.383016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:53.383627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.532260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:53.539577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-804ad6f9-66d8-4cb3-8927-c432e0b88d80 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.170743 May 09 09:47:53.540473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:53 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:53.548847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:53.549641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:53.556345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:53.556846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.557793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:53.558412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.618575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:53.626606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6435733e-9b2a-443e-af60-4e7b682df63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1292 microversion: 2.1 time: 0.083176 May 09 09:47:53.627177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:53 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:53.871187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:53.872247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:53.879659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:53.880107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.880914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:53.881342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:53.948955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:53.957187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:53.958673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:53.959771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-639d5c80-c3ff-48ef-8e34-0fc2a9c821d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1339 microversion: 2.20 time: 0.095135 May 09 09:47:53.960334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 46/90] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:54.049177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:54.049804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:54.066616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.069218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:54.070087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.070515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:54.208498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:54.216985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cfbd1f0c-4838-4e95-a640-99c754a072ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1289 microversion: 2.1 time: 0.171839 May 09 09:47:54.228807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 45/91] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:54.557580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:54.558494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:54.566528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.567039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:54.567849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.568286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:54.647691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:54.648777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:54.655978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.656804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:54.657574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.657999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:54.777493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:54.802467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7448815c-be5c-4a86-a242-00ff438aa234 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1280 microversion: 2.1 time: 0.158846 May 09 09:47:54.821450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 46/92] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:54 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:54.979474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:54.980255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:54.991035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:54.992477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:55.014770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:55.020584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:55.027925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:55.047434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee0a1b19-449d-44a7-bb01-29e270470561 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.494228 May 09 09:47:55.058203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 47/93] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:54 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:55.119967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-938f208f-4778-41c8-a529-d055cafdcddf req-27e41601-7739-4ffe-ac1b-93a2b49fdc03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1", "tag": "6aeb5a3e-699b-40df-b1af-50d7e539a438"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:55.138225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-938f208f-4778-41c8-a529-d055cafdcddf req-27e41601-7739-4ffe-ac1b-93a2b49fdc03 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:55.138863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-938f208f-4778-41c8-a529-d055cafdcddf req-27e41601-7739-4ffe-ac1b-93a2b49fdc03 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:55.167372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-938f208f-4778-41c8-a529-d055cafdcddf req-27e41601-7739-4ffe-ac1b-93a2b49fdc03 service nova] Creating event network-changed:6aeb5a3e-699b-40df-b1af-50d7e539a438 for instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 on hv-cinder-84108 May 09 09:47:55.181527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-938f208f-4778-41c8-a529-d055cafdcddf req-27e41601-7739-4ffe-ac1b-93a2b49fdc03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062233 May 09 09:47:55.183049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 48/94] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:47:55.216257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:55.232642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:55.237904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:55.239989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5ca32a2-96e0-4663-bb17-1905fe6009f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1339 microversion: 2.20 time: 0.265594 May 09 09:47:55.243516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:55.245122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:55.253452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 47/95] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1339 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:55.257013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:55.259339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:55.260375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:55.263106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:55.439188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:55.450807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82a83f45-fc16-464e-bed5-76cfa43cdb63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1295 microversion: 2.1 time: 0.214774 May 09 09:47:55.451616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 49/96] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1295 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:55.820793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:55.821325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:55.834730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:55.835159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:55.837630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:55.838221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.075219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:56.075830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:56.083957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:56.087368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.088367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:56.091376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.421445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:56.433226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-964311d0-cc1c-4f1e-b0b5-66a923a5f000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.617436 May 09 09:47:56.434231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 48/97] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:55 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:56.449675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:56.450309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:56.457749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:56.458193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.459120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:56.459725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.657990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:56.666178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97a4dfae-3933-4b29-b696-5621f079fa49 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.595437 May 09 09:47:56.667368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 50/98] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:56 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:47:56.684126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:56.684993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:56.691987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:56.693061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.694128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:56.694661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:56.876249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:56.885221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2279a9d9-80ac-4928-950c-10e216b9d1f6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1295 microversion: 2.1 time: 0.206515 May 09 09:47:56.886577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 51/99] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1295 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:56.947896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:56.962794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:56.965107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:56.966812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44444a22-0fc3-44c7-818b-fb6880a8bc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.531608 May 09 09:47:56.976951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 49/100] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:57.381228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-c8bb6445-2b98-4940-9407-3a44679a077e req-0b7d5f65-5265-4748-9b4d-313cd4f8ff29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fba23c7-5891-4c59-b6bb-fdf8705aedfc", "tag": "23ef4361-2d67-4758-8fee-e25f0fd77c09"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:57.389493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c8bb6445-2b98-4940-9407-3a44679a077e req-0b7d5f65-5265-4748-9b4d-313cd4f8ff29 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.390022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c8bb6445-2b98-4940-9407-3a44679a077e req-0b7d5f65-5265-4748-9b4d-313cd4f8ff29 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:57.408845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-c8bb6445-2b98-4940-9407-3a44679a077e req-0b7d5f65-5265-4748-9b4d-313cd4f8ff29 service nova] Creating event network-changed:23ef4361-2d67-4758-8fee-e25f0fd77c09 for instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc on hv-cinder-84108 May 09 09:47:57.418952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-c8bb6445-2b98-4940-9407-3a44679a077e req-0b7d5f65-5265-4748-9b4d-313cd4f8ff29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041268 May 09 09:47:57.420224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 52/101] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:47:57.451208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:57.451750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:57.471017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.471595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:57.472455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.472914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:57.690556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:57.691514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:57.700457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.701077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:57.702135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.702563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:57.771290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:57.778728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5a55bdd-09ed-4657-b1ea-e555f9f866c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.333352 May 09 09:47:57.781350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 50/102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:57 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:57.909319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:57.910255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:57.917837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.918509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:57.919478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:57.920406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.014877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:58.025832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7155b8b1-df07-4bbd-b480-0ae6db699f8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1295 microversion: 2.1 time: 0.127257 May 09 09:47:58.027217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 51/103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:58.032543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:58.033423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:58.042563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.043261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.044191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.044762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.193120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:58.201348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:58.204753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:58.206193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4ece146-320c-44b2-9a92-1c0f1e78e610 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.177840 May 09 09:47:58.209329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 52/104] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:58.319009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:58.343429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a4d5681-a413-4086-97a4-d8feaac940ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.663436 May 09 09:47:58.354176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 53/105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:57 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:58.681435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-692dd132-b32e-477f-b759-54833b252be9 req-9b957c99-fc85-4acc-9280-252e3e0f5462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:47:58.710808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-692dd132-b32e-477f-b759-54833b252be9 req-9b957c99-fc85-4acc-9280-252e3e0f5462 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.711269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-692dd132-b32e-477f-b759-54833b252be9 req-9b957c99-fc85-4acc-9280-252e3e0f5462 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.740794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-692dd132-b32e-477f-b759-54833b252be9 req-9b957c99-fc85-4acc-9280-252e3e0f5462 service nova] Creating event network-changed:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 09:47:58.741652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-692dd132-b32e-477f-b759-54833b252be9 req-9b957c99-fc85-4acc-9280-252e3e0f5462 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 09 09:47:58.743603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.744244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.745186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.745785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.757233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.compute.rpcapi [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 09 09:47:58.758448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] Releasing lock "compute-rpcapi-router" {{(pid=123637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 09 09:47:58.787675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3623f911-7b83-49b5-b6ec-4b06c230c953 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195585 May 09 09:47:58.791331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 53/106] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:47:58.798388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:58.798992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:58.804979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.805420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:58.806184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:58.806629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.011427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:59.020644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-08fd7fd5-d978-4b81-a093-31dade68ed82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.226324 May 09 09:47:59.021241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 54/107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:58 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:59.043336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:59.044042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:59.051569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:59.052127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.052841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:59.053279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.234745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:59.235358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:59.244142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:59.244636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.245541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:59.246026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.278455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:59.289735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cedf7a3b-74c5-42c6-931b-f61b2281b71a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.250742 May 09 09:47:59.290316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 54/108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:47:59.360904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:47:59.361717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:47:59.368487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:59.371492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.373441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:47:59.374931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:47:59.418625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:59.426882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:59.428599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:59.436892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91f9326d-2fc2-478c-8999-04133976d8c7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.204137 May 09 09:47:59.447864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 55/109] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:47:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:47:59.519845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:47:59.528867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-558aabf6-5fb4-407e-a992-0a8a250bbca5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.170726 May 09 09:47:59.528867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 55/110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:47:59 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:00.037977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:00.039145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:00.045742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.046405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.047330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.047903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.187968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:00.196590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d85e8d9-6bd5-40fe-a754-70bd9faed7e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.162633 May 09 09:48:00.197360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 56/111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:00 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:00.309545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:00.311458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:00.319356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.320808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.321838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.322378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.456375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:00.457292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:00.464689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.465443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.469236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.470276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.492478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:00.501085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-60f006f8-ae19-4553-980f-00751905a9b0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.198058 May 09 09:48:00.501737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 56/112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:00.545956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:00.546790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:00.553022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.553678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.555108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:00.555718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:00.701268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:00.720776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:00.726093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:00.727585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:00.728709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0aaa942-2a40-4560-9e99-9feda38b928d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.278122 May 09 09:48:00.728977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-286bc215-c51d-4c54-b930-bf88f014d4fd tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.187871 May 09 09:48:00.729279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 57/113] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:48:00.729876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:00 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:01.213589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:01.214115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:01.222383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.223176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.224305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.225244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.443034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:01.450768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1cb8a5fc-a394-4762-9f6f-0ff7dab6afbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.241061 May 09 09:48:01.453646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 58/115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:01 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:01.519082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:01.519703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:01.526832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.527276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.528056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.528470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.672205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:01.680400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-447ef85b-d6e7-4de9-8417-7b9d4edf426b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.165598 May 09 09:48:01.686855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 58/116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:01.748513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:01.753422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:01.754921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:01.756285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:01.761612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.762181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.762834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.763350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.767478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.768118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.769345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:01.770980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:01.988729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:02.002615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:02.005846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:02.008251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6da8d2bd-eda0-47be-b500-09a46496340f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.264469 May 09 09:48:02.019011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 59/117] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:02.040107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:02.050975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79c385b2-18bf-4e3d-a6fa-028f881aecc1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.306952 May 09 09:48:02.052418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 59/118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:01 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:02.468284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:02.469149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:02.489814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:02.490271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:02.491064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:02.491490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:02.688507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:02.696999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4bca2a9b-c203-42f5-8b5a-b9d68481bb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.233328 May 09 09:48:02.703222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:02.703831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:02.707373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 60/119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:02 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:02.711849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:02.712358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:02.713330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:02.713823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.027173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:03.028115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:03.036288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:03.039475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.040459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:03.042784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.055310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:03.074215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e4542cf4-0b0c-41d2-b594-3ead5c71a5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.373961 May 09 09:48:03.075102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 60/120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:03.091041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:03.092079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:03.109578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:03.112616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.116721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:03.117390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.351241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:03.359957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10d755e9-e50d-4cd9-8fbe-6093b9cc7920 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.283602 May 09 09:48:03.360873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 61/121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:03 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:03.706429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:03.714623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:03.715850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:03.725086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:03.725366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:03.727625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:03.727762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.728405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:03.728894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:03.730066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ae96455-d7b7-4830-8d7c-ef2772da7066 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.707061 May 09 09:48:03.731181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 61/122] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:03.985290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:03.995734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba3abd0d-acc4-406c-97f6-aa35840848ab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.284980 May 09 09:48:03.996653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 62/123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:03 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:04.094197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:04.095764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:04.104622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:04.105347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:04.106325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:04.107412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:04.379614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:04.380979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:04.408735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:04.415517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:04.418177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:04.419916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:04.639408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:04.670770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c726de1-9c1e-40b3-94b6-1d2ae64f7d48 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.582556 May 09 09:48:04.671732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 62/124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:04.758175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:04.759681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:04.766575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:04.767032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:04.767915 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:04.768706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:04.835509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:04.853823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-054ff5e4-6186-4964-861d-b99743ec7398 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.478652 May 09 09:48:04.863955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 63/125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:04 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:05.013157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:05.013830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:05.024191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.024508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:05.025330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.029888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:05.282948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:05.292059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:05.298238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:05.301353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a126bc5-cc7b-4c19-af1b-c64f30419f88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.547824 May 09 09:48:05.317932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 63/126] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:48:05.415705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-9db3f01d-5174-4448-9e1a-13cf6793a295 req-05e9cdc0-2bc1-4ea9-941f-fb79c7bfb325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3383afcd-c1f1-4a06-b1e3-3bd49e32744a", "tag": "0533b6e6-0caa-4e2c-8fb3-327f73627c13"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:05.428055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:05.429865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9db3f01d-5174-4448-9e1a-13cf6793a295 req-05e9cdc0-2bc1-4ea9-941f-fb79c7bfb325 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.431653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9db3f01d-5174-4448-9e1a-13cf6793a295 req-05e9cdc0-2bc1-4ea9-941f-fb79c7bfb325 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:05.440381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7599f476-565c-4e87-bcf6-b917d7c65c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.431538 May 09 09:48:05.441448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 64/127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:05 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:05.467790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-9db3f01d-5174-4448-9e1a-13cf6793a295 req-05e9cdc0-2bc1-4ea9-941f-fb79c7bfb325 service nova] Creating event network-changed:0533b6e6-0caa-4e2c-8fb3-327f73627c13 for instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a on hv-cinder-84108 May 09 09:48:05.478359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-9db3f01d-5174-4448-9e1a-13cf6793a295 req-05e9cdc0-2bc1-4ea9-941f-fb79c7bfb325 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066554 May 09 09:48:05.483854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 64/128] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:48:05.688029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:05.688970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:05.696018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.696555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:05.697446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.697937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:05.876653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:05.878293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:05.892312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.894178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:05.895225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:05.899081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:06.018467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:06.026949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b8100477-41ea-48c2-9bd0-88c2723b3e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.343473 May 09 09:48:06.027819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 65/129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:06.328052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:06.329015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:06.338516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:06.339449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:06.340555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:06.341466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:06.413824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:06.425744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53a360af-3bd6-434d-bddb-7596950ba01b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.556238 May 09 09:48:06.427239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 65/130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:05 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:06.459498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:06.460126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:06.479199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:06.481076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:06.482084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:06.485220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:06.566887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:06.574713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:06.576246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:06.578390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-667e56c3-e2ee-4af8-ae3e-36691da1e4c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.257640 May 09 09:48:06.579428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 66/131] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:06.760187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:06.770160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72dce66b-42c8-4312-b0de-44d2fcdb9425 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.314441 May 09 09:48:06.772147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 66/132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:06 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:07.043288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:07.044514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:07.079409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:07.079848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:07.080627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:07.089348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:07.443204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:07.443837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:07.460217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:07.460686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:07.461458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:07.461881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:07.677527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:07.687811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-943aff7d-b579-4575-8b51-397c569b23a8 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.248135 May 09 09:48:07.689604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 67/133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:07 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:07.699480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:07.701609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:07.717213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:07.723479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:07.724569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:07.725044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:08.158199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:08.185264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:08.190653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:08.194040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff90f8d2-612a-4cdb-b852-6b3d61e894ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.501750 May 09 09:48:08.205730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 68/134] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:08.210619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:08.212084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:08.225586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:08.228130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:08.229744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:08.233550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:08.257173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:08.269997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7379bc5-9a13-4a2e-a9aa-d8217c8977ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 1.230428 May 09 09:48:08.276149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 67/135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:08.666372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:08.679774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-467251be-9b22-4cb2-8f82-c63f77657cda tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.480610 May 09 09:48:08.680592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 69/136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:08 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:08.707912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:08.710159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:08.717687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:08.718358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:08.719828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:08.720469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:08.794592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-3da6ce00-149b-4ba0-919a-5d87012c6ee0 req-46a687d3-e333-42d6-ba9f-9b67202bcf8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84adda1-a8c2-4797-8f59-a9a2d21eb25b", "name": "network-vif-plugged", "status": "completed", "tag": "125310e8-6b4c-43ae-8571-626698644e8d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:08.805350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3da6ce00-149b-4ba0-919a-5d87012c6ee0 req-46a687d3-e333-42d6-ba9f-9b67202bcf8a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:08.805790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3da6ce00-149b-4ba0-919a-5d87012c6ee0 req-46a687d3-e333-42d6-ba9f-9b67202bcf8a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:08.820752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-3da6ce00-149b-4ba0-919a-5d87012c6ee0 req-46a687d3-e333-42d6-ba9f-9b67202bcf8a service nova] Creating event network-vif-plugged:125310e8-6b4c-43ae-8571-626698644e8d for instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b on hv-cinder-84108 May 09 09:48:08.826992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-3da6ce00-149b-4ba0-919a-5d87012c6ee0 req-46a687d3-e333-42d6-ba9f-9b67202bcf8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.549528 May 09 09:48:08.828008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 68/137] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:48:09.063116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:09.075112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd307ddf-7168-487b-ab82-6fe9c942a1ca tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.373058 May 09 09:48:09.086522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 70/138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:08 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:09.221345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:09.222273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:09.248325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:09.249582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:09.254406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:09.255368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:09.294926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:09.296372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:09.319582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:09.320218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:09.321540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:09.324130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:09.618968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:09.630240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ea44146-efc0-4d66-8085-c5ab98710709 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.343220 May 09 09:48:09.631143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 71/139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:09.698142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:09.699654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:09.708012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:09.710309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:09.712046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:09.712981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:09.714975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:09.729544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:09.733429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:09.736622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10db7546-39b4-4b17-abdb-dffc7fdb4bf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.524607 May 09 09:48:09.737266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 69/140] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:09.998230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:10.006589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6249874f-858c-4860-96f7-5932e2994e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.312783 May 09 09:48:10.007187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 72/141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:09 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:10.096335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:10.097679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:10.119304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:10.121176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:10.124143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:10.126477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:10.486791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:10.498763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9967a90d-15ce-4597-9b81-0951e48efa32 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.410653 May 09 09:48:10.499354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 70/142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:10 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:10.648420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:10.649073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:10.662333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:10.663574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:10.667626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:10.669110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:10.766614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:10.768494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:10.801732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:10.805409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:10.806430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:10.807078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:11.009057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:11.020392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d85c70b1-e171-451f-84d7-2a2e28934afb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.376477 May 09 09:48:11.023758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 73/143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:11.058353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:11.061191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:11.075948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:11.077751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:11.085787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:11.086654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:11.088014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:11.104079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:11.109526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:11.116809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bab52108-3a1d-46ae-bab1-79c515be7ece tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.365972 May 09 09:48:11.117421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 71/144] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:48:11.491548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:11.503529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b03897f7-d4cc-4cb6-9cbf-741a55a8f9e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.458854 May 09 09:48:11.504575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 74/145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:11 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:11.516004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:11.516617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:11.528120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:11.528579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:11.529439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:11.529872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:11.772826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:11.785952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ff924c4-e7a2-47b4-8b3e-bf7fc6fc221b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.273852 May 09 09:48:11.786541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 72/146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:11 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:12.044799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:12.045320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:12.054725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.057074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.058580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.061792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.135506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:12.136372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:12.153141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.153870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.154987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.155698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.398296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:12.407330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1fc7790-7437-4e33-8f63-34adb6be9e41 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.367155 May 09 09:48:12.408657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 75/147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:12.421068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:12.443888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:12.446497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:12.448279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-61e9a980-a83f-4dd7-b2ea-4408f8b23dae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.316305 May 09 09:48:12.449542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 73/148] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:12.520772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:12.525498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:12.551389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.552193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.553332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.553984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.803489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:12.805968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:12.816563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.819487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.821432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:12.822987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:12.864129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:12.877868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84f03ffc-8c67-4110-8396-6388d6749716 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.360832 May 09 09:48:12.887045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 76/149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:12 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:13.153664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:13.162371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-942bc52c-17b0-4497-92af-76bac410f1c5 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.363001 May 09 09:48:13.169803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 74/150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:12 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:13.429272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:13.429933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:13.465397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:13.466052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:13.467342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:13.469484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:13.470414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:13.472106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:13.483995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:13.488394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:13.490595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:13.493262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:14.046023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:14.054761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:14.056525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:14.057862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ffe275b8-cede-4306-a31e-d2b0782a335a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.594723 May 09 09:48:14.059070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 75/151] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:14.073810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:14.074432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:14.083736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:14.084193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:14.085003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:14.085620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:14.205285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:14.218263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68b4009d-9c22-412b-9db6-b146bd451422 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.794511 May 09 09:48:14.229045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 77/152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:14.250416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:14.257805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:14.272344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:14.287769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:14.289074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:14.289653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:14.336151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:14.346310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96177c26-cbaf-4644-b714-dd89129a36c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.286012 May 09 09:48:14.349109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 76/153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:14 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:14.768576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:14.781672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a4f5f269-3149-4f65-8499-375fe44718cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.541067 May 09 09:48:14.786165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 78/154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:14 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:15.077660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:15.079952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:15.092791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:15.093241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:15.105152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:15.108157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:15.238304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:15.238949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:15.248040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:15.248490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:15.249307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:15.249745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:15.678910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:15.696412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:15.698442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:15.709589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16ff84bc-d93a-4c19-b11d-822a960c595c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.633687 May 09 09:48:15.721556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 77/155] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:15.734958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:15.738845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:15.757060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:15.757336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:15.758046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:15.758634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:16.078720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:16.086767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57d7986e-2c12-4f25-95ed-4789ba7c2d7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.360985 May 09 09:48:16.091687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 78/156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:15 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:16.118320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:16.119291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:16.126714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:16.127609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:16.128591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:16.129250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:16.208777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:16.224579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3ab69c92-701e-41a8-a6c1-bd7196207ce3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.993142 May 09 09:48:16.241775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 79/157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:16.487777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-135d7200-355b-40e2-9839-a93f5e5293b3 req-e0631a33-d231-44f5-b40d-c6be0e9b3f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1", "name": "network-vif-plugged", "status": "completed", "tag": "6aeb5a3e-699b-40df-b1af-50d7e539a438"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:16.506910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-135d7200-355b-40e2-9839-a93f5e5293b3 req-e0631a33-d231-44f5-b40d-c6be0e9b3f8c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:16.507371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-135d7200-355b-40e2-9839-a93f5e5293b3 req-e0631a33-d231-44f5-b40d-c6be0e9b3f8c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:16.520203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:16.530625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89b32410-f6c4-4e7a-a02f-c8bc616ee78c tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.437518 May 09 09:48:16.538206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 79/158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:16 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:16.559250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-135d7200-355b-40e2-9839-a93f5e5293b3 req-e0631a33-d231-44f5-b40d-c6be0e9b3f8c service nova] Creating event network-vif-plugged:6aeb5a3e-699b-40df-b1af-50d7e539a438 for instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 on hv-cinder-84108 May 09 09:48:16.588970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-135d7200-355b-40e2-9839-a93f5e5293b3 req-e0631a33-d231-44f5-b40d-c6be0e9b3f8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105066 May 09 09:48:16.593455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 80/159] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:48:16.729476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:16.730896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:16.748241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:16.750092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:16.751020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:16.751898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.108024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:17.108820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:17.119936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:17.122702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.123598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:17.126803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.134458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:17.147538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:17.151565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:17.160950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-482add52-46db-4efe-9a49-2a28b6a6d74c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.430211 May 09 09:48:17.162233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 80/160] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:17.247814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:17.248570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:17.263272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:17.263710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.264676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:17.265278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.478588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:17.489362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e98333ad-ad46-41cb-944c-b3aabf9cfd9b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.386918 May 09 09:48:17.499647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 81/161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:17 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:17.563531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:17.565227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:17.573052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:17.573575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.574261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:17.584542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:17.683985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:17.694974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-52602c70-8b92-4d56-80cf-2ea80a09322f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.451006 May 09 09:48:17.707626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:18.079568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:18.091670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d121da5-632f-49f6-acbd-5c8c5051a50d tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.538736 May 09 09:48:18.094367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 82/163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:17 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:18.180426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:18.181517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:18.200033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.203825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.208025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.209613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.414803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:18.423172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:18.427034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:18.428180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3644271e-71e5-40f5-aa63-88876c1a60f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.252515 May 09 09:48:18.430292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 82/164] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:18.506417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:18.507026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:18.513289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.513744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.514515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.514954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.621897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-f1084827-60c0-475d-8fe1-9e9ee97a85e1 req-d1ddcaa0-997d-4b95-b2c0-9076bc1b0c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "name": "network-vif-plugged", "status": "completed", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:18.651901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f1084827-60c0-475d-8fe1-9e9ee97a85e1 req-d1ddcaa0-997d-4b95-b2c0-9076bc1b0c37 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.652549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f1084827-60c0-475d-8fe1-9e9ee97a85e1 req-d1ddcaa0-997d-4b95-b2c0-9076bc1b0c37 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.686550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-f1084827-60c0-475d-8fe1-9e9ee97a85e1 req-d1ddcaa0-997d-4b95-b2c0-9076bc1b0c37 service nova] Creating event network-vif-plugged:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 09:48:18.693057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-f1084827-60c0-475d-8fe1-9e9ee97a85e1 req-d1ddcaa0-997d-4b95-b2c0-9076bc1b0c37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075140 May 09 09:48:18.694039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 83/165] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:48:18.719336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:18.729583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-102cf2a1-0ce5-4dcc-9cb2-4b38c84f9c28 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.227231 May 09 09:48:18.732201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 83/166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:18 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:18.740222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:18.741487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:18.763962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.764741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.765913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:18.766871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:18.937967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:18.947489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab49db47-e4d8-4a72-bb8d-e40427608c8e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.213619 May 09 09:48:18.948432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 84/167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:19.089294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3ad906a9-b895-4748-8988-9e846e4b474c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Action: 'create', calling method: .version_select at 0x7fa464c02670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-199242016"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:19.109359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:19.109960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:19.119535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.121196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.121999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.125213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.136578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-3ad906a9-b895-4748-8988-9e846e4b474c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for project 39c36cb22c2846e480c26840635bf29c. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:48:19.144786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-3ad906a9-b895-4748-8988-9e846e4b474c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for user 1c091a71e2ad46ceafe25be874c016a6 and project 39c36cb22c2846e480c26840635bf29c. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:48:19.379613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:19.384336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de4c3309-a38b-43db-a315-c0c0451fe8c1 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1314 microversion: 2.1 time: 0.278059 May 09 09:48:19.385469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 85/168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:19 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:19.393309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-3ad906a9-b895-4748-8988-9e846e4b474c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for project 39c36cb22c2846e480c26840635bf29c. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:48:19.400043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-3ad906a9-b895-4748-8988-9e846e4b474c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for user 1c091a71e2ad46ceafe25be874c016a6 and project 39c36cb22c2846e480c26840635bf29c. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:48:19.422312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3ad906a9-b895-4748-8988-9e846e4b474c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.726842 May 09 09:48:19.423690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 84/169] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 09:48:18 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:19.448522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:19.449115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:19.471659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.472304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.475997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.476647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.748607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:19.749526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:19.761814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.762543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.763584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.764006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.798644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:19.806369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:19.807857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:19.811616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99233892-2d0a-42ac-90b4-7bb3f065fc69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.367932 May 09 09:48:19.825087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 86/170] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:19.965225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:19.966066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:19.978782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.979956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:19.981540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:19.984227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:20.010748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:20.024779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-69dd0f78-718d-403a-8fcf-088d91d4bf49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.278816 May 09 09:48:20.036834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 85/171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:19 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:20.228208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:20.236107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8178a2cd-fa18-484d-8dc8-e455fd5ef530 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.275977 May 09 09:48:20.249570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 87/172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:20.405396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:20.406347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:20.414199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:20.415799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:20.416859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:20.418098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:20.767408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:20.775619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95741a0a-4e9e-49c8-82e6-4a66f91b7c3e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1500 microversion: 2.1 time: 0.377840 May 09 09:48:20.776254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 86/173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:20 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1500 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:20.835210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:20.835829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:20.845510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:20.846336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:20.847188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:20.847622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:21.042818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:21.043651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:21.060099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:21.064138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:21.069597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:21.072284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:21.177418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:21.187895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:21.189967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:21.191262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b26fb31d-6827-4755-84fa-f82ca13d5f1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.362542 May 09 09:48:21.192230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 88/174] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:21.253514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:21.254126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:21.272958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:21.274235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:21.275262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:21.285263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:21.640628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:21.652784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-162abc68-51e5-48cd-b08e-bce89d206e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.403357 May 09 09:48:21.655110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 89/175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:21.664107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-8bb5bc71-d2d3-4335-997d-26c2adfc7629 req-1ce0bdd8-f71c-4170-abce-13cfa4cac78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fba23c7-5891-4c59-b6bb-fdf8705aedfc", "name": "network-vif-plugged", "status": "completed", "tag": "23ef4361-2d67-4758-8fee-e25f0fd77c09"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:21.675001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-8bb5bc71-d2d3-4335-997d-26c2adfc7629 req-1ce0bdd8-f71c-4170-abce-13cfa4cac78f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:21.675001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-8bb5bc71-d2d3-4335-997d-26c2adfc7629 req-1ce0bdd8-f71c-4170-abce-13cfa4cac78f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:21.705745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-8bb5bc71-d2d3-4335-997d-26c2adfc7629 req-1ce0bdd8-f71c-4170-abce-13cfa4cac78f service nova] Creating event network-vif-plugged:23ef4361-2d67-4758-8fee-e25f0fd77c09 for instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc on hv-cinder-84108 May 09 09:48:21.710908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:21.714825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-8bb5bc71-d2d3-4335-997d-26c2adfc7629 req-1ce0bdd8-f71c-4170-abce-13cfa4cac78f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057670 May 09 09:48:21.716569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 90/176] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:48:21.719759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20131d14-9ab3-4bf1-8380-bd4618184690 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.682380 May 09 09:48:21.728979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 87/177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:21 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:22.210337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:22.212700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:22.224484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.224992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.227195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.227880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.430779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:22.440203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:22.441723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:22.448720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4038e48e-cf7c-4d53-a6b9-1b99b6fc0b90 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.243019 May 09 09:48:22.449275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 91/178] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:22.651882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "752344dc-e0e5-4be5-bfc7-e3746c63e08a"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:22.653369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:22.664754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.665240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.667072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.668195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.674136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:22.678305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:22.686126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.687512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.688626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.689284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.925681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:22.938074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cff80f20-f56b-4b5f-b8ec-a665fc955aa9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.270005 May 09 09:48:22.938829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 92/179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:22.945306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:22.946573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:22.958396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.958845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:22.959628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:22.960067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:23.153032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:23.161388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9bae9940-870b-468e-950b-37ada1a90449 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.221240 May 09 09:48:23.163580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 93/180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:22 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:23.288138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aedc169f-b0d2-435d-aa02-5af2a62118ea tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "POST /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.643824 May 09 09:48:23.292701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 88/181] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:48:22 2022] POST /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:48:23.467422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:23.468274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:23.475909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:23.476744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:23.477696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:23.478272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:23.713265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:23.727205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:23.729626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:23.731059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2699ec6f-5872-4ed6-8130-a7874cca1578 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1406 microversion: 2.20 time: 0.267584 May 09 09:48:23.733446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 94/182] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:23.768542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-b403a49a-1b3c-4514-8097-948930e9bba1 req-962af28f-e93e-4a9e-8bbe-7ffcb8889629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3383afcd-c1f1-4a06-b1e3-3bd49e32744a", "name": "network-vif-plugged", "status": "completed", "tag": "0533b6e6-0caa-4e2c-8fb3-327f73627c13"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:23.786694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b403a49a-1b3c-4514-8097-948930e9bba1 req-962af28f-e93e-4a9e-8bbe-7ffcb8889629 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:23.787171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b403a49a-1b3c-4514-8097-948930e9bba1 req-962af28f-e93e-4a9e-8bbe-7ffcb8889629 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:23.822321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-b403a49a-1b3c-4514-8097-948930e9bba1 req-962af28f-e93e-4a9e-8bbe-7ffcb8889629 service nova] Creating event network-vif-plugged:0533b6e6-0caa-4e2c-8fb3-327f73627c13 for instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a on hv-cinder-84108 May 09 09:48:23.829935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-b403a49a-1b3c-4514-8097-948930e9bba1 req-962af28f-e93e-4a9e-8bbe-7ffcb8889629 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066936 May 09 09:48:23.831300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 89/183] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 09 09:48:23.956313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:23.957181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:23.970199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:23.971423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:23.972890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:23.973816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:24.164627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:24.180164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-42d610a2-cf48-4c0c-ab57-1b1394de0378 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.228552 May 09 09:48:24.181329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 95/184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:24.190645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:24.191674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:24.201067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:24.201799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:24.202797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:24.203456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:24.381209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:24.391741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a949e126-07c1-4450-a900-5b938bd2759f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.216158 May 09 09:48:24.392914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 90/185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:24 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:24.758671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:24.759858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:24.766063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:24.766618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:24.767469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:24.767984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:24.928557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:24.938945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:24.940816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:24.942143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a399271d-1a57-492d-8e9f-cd4db7a01d2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1599 microversion: 2.20 time: 0.187743 May 09 09:48:24.942925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 96/186] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:48:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:48:24.961273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:24.961769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:24.983469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:24.989824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:24.990847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:24.991444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:25.117258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fbbb4abc-48f8-486e-be54-9a8f970e8f73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.159894 May 09 09:48:25.121034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 91/187] 10.222.0.26 () {60 vars in 1315 bytes} [Mon May 9 09:48:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:48:25.199834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:25.200906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:25.209168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:25.209981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:25.211276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:25.212026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:25.417719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:25.419038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:25.427462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:25.428241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:25.429445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:25.430149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:25.672383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:25.680431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2f3a05e-6a69-49f1-8fb1-25f01ed1f7e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.486508 May 09 09:48:25.683392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 97/188] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:26.195207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:26.202964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc2be014-ec2a-4727-8939-379ca2431796 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1322 microversion: 2.1 time: 0.797688 May 09 09:48:26.204247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 92/189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:25 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1322 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:26.708510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:26.709543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:26.721669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:26.722270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:26.723265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:26.724051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:26.943170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:26.955595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65de088f-7024-4bcb-b801-a5dcee5ebbc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.253043 May 09 09:48:26.955595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 98/190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:27.222004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:27.222612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:27.235527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.236418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.240740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.242107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.298846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-ac882ee0-b51e-4a28-b412-ee0eb86d82fa req-2b617619-8823-42b6-930e-736d1dd7a451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:27.311120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ac882ee0-b51e-4a28-b412-ee0eb86d82fa req-2b617619-8823-42b6-930e-736d1dd7a451 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.311556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ac882ee0-b51e-4a28-b412-ee0eb86d82fa req-2b617619-8823-42b6-930e-736d1dd7a451 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.340309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-ac882ee0-b51e-4a28-b412-ee0eb86d82fa req-2b617619-8823-42b6-930e-736d1dd7a451 service nova] Creating event network-changed:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 09:48:27.358620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-ac882ee0-b51e-4a28-b412-ee0eb86d82fa req-2b617619-8823-42b6-930e-736d1dd7a451 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063208 May 09 09:48:27.365409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 99/191] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:48:27.536216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:27.550833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0182b550-41b2-4162-8114-355c5ad2997e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1516 microversion: 2.1 time: 0.333297 May 09 09:48:27.551656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 93/192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:27 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:27.569210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:27.570459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:27.581020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.583960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.584815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.585246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.670840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'flavor' on Instance uuid 0fba23c7-5891-4c59-b6bb-fdf8705aedfc {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:48:27.871267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9eb0c1c3-a75c-406d-879d-57adfd81a2e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc/action" status: 200 len: 32 microversion: 2.1 time: 0.306480 May 09 09:48:27.881551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:27.882598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:27.883416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 100/193] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:48:27 2022] POST /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 09:48:27.901826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.904561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.905490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:27.905927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:27.975227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:27.975940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:27.997767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:28.001670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:28.004646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:28.010114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:28.181024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:28.192720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1d5d387-e0f1-4ac7-bfcc-ebb3ecf3339e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.315446 May 09 09:48:28.194310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 94/194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:27 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:28.324002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:28.332577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-40397670-fe8e-478f-b209-270150a9308d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1363 microversion: 2.1 time: 0.363178 May 09 09:48:28.333473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 101/195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:29.210569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:29.212161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:29.219978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:29.220833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:29.221836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:29.222552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:29.351198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:29.355154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:29.363503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:29.365003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:29.366054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:29.366848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:29.543055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:29.556158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ac5f5aa-8532-4d78-a6d4-7e034f338dc4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.349738 May 09 09:48:29.557779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 95/196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:29 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:29.618236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:29.627805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c20250c0-b610-4687-94b8-68f4bef6fba1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1549 microversion: 2.1 time: 0.280770 May 09 09:48:29.641924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 102/197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1549 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:29.648470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:29.649487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:29.656550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:29.661227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:29.662146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:29.662743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:29.759822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b16e780-c159-4810-9b34-9b6218435eb1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117365 May 09 09:48:29.760597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 96/198] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 09:48:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:48:30.573574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:30.574763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:30.580881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:30.581351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:30.582124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:30.582542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:30.721499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:30.729094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3d1bed9-ce52-496c-b040-9d91f3d7afc8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.159309 May 09 09:48:30.729980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 103/199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:30 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:30.908620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-199fb76d-b410-426c-9861-8c214b2c3125 req-3e93695a-f7e8-4e09-a77f-3e1c6840b1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3383afcd-c1f1-4a06-b1e3-3bd49e32744a", "tag": "0533b6e6-0caa-4e2c-8fb3-327f73627c13"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:30.917225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-199fb76d-b410-426c-9861-8c214b2c3125 req-3e93695a-f7e8-4e09-a77f-3e1c6840b1d3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:30.917662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-199fb76d-b410-426c-9861-8c214b2c3125 req-3e93695a-f7e8-4e09-a77f-3e1c6840b1d3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:30.929302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-199fb76d-b410-426c-9861-8c214b2c3125 req-3e93695a-f7e8-4e09-a77f-3e1c6840b1d3 service nova] Creating event network-changed:0533b6e6-0caa-4e2c-8fb3-327f73627c13 for instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a on hv-cinder-84108 May 09 09:48:30.938598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-199fb76d-b410-426c-9861-8c214b2c3125 req-3e93695a-f7e8-4e09-a77f-3e1c6840b1d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033921 May 09 09:48:30.939434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 97/200] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:48:31.748544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:31.749952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:31.756035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:31.756428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:31.757582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:31.757976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:31.901048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:31.917330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-058e92ea-ab0c-4d7f-96be-a7c9c217de7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.173628 May 09 09:48:31.918288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 104/201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:31 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:32.936077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:32.936847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:32.942959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:32.943426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:32.944180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:32.944611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:33.085866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:33.094293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-364ea3ac-c2ce-4ecf-b24a-4898cff4437d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.162864 May 09 09:48:33.100718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 98/202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:32 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:34.114935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:34.116082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:34.124899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:34.125357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:34.126132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:34.126569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:34.258464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:34.266400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-194d8bbb-dc1d-43d3-8669-03c0f773caf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.158113 May 09 09:48:34.267044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 105/203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:34 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:35.283417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:35.284225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:35.292201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:35.292654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:35.293460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:35.293893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:35.418762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:35.426759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c0a2bbbd-8c3d-4891-aca1-cfe9478b15e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.147345 May 09 09:48:35.427362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 99/204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:35 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:36.443184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:36.443800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:36.450091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:36.450528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:36.451337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:36.451770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:36.593027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:36.600444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-443b414b-263f-4bf9-889e-2b415fc1656b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.161047 May 09 09:48:36.601040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 106/205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:36 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:37.621275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:37.622175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:37.629993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:37.630445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:37.631196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:37.631641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:37.781932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:37.789511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7e2f341-e3bd-4c2c-9bad-dc28c26852d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.174879 May 09 09:48:37.790080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 100/206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:37 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:38.806709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:38.807294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:38.814040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:38.814478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:38.815238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:38.815665 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:38.951154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:38.959918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e844c9e1-4139-4cd1-b210-adeb7ae8a1c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.157046 May 09 09:48:38.961225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 107/207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:38 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:39.980098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:39.980746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:39.990472 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:39.991079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:39.992168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:39.992789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:40.139715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:40.148337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dab20b3c-1b08-43ac-a484-ba38503a42d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.173769 May 09 09:48:40.148981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 101/208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:39 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:41.168078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:41.169006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:41.176781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:41.177241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:41.178008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:41.178447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:41.306309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:41.315549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbca4213-e2a6-4732-9064-4cef20f3e1dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.153755 May 09 09:48:41.316127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 108/209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:41 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:42.336431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:42.337476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:42.346725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:42.347174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:42.347943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:42.348373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:42.497322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:42.505504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72fd5261-7b21-490f-b474-b3a2dfaea080 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.175679 May 09 09:48:42.506094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 102/210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:42 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:43.523413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:43.524003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:43.531076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:43.531550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:43.532376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:43.532866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:43.665049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:43.673931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d504eb2-9aae-46b2-9949-7fa09a72f60a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.154567 May 09 09:48:43.683354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 109/211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:43 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:43.825949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:43.826556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:43.833819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:43.834640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:43.836688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:43.838017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:43.866965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 09:48:43.961403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1bd2802b-13a2-4e54-a2d8-fe05361d3a0b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 204 len: 0 microversion: 2.1 time: 0.140023 May 09 09:48:43.962029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 103/212] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 09:48:43 2022] DELETE /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 09:48:43.971220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:43.972060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:43.979816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:43.980369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:43.981491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:43.982094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:44.131253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:44.140226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0ee6806-7dbd-40e1-bdf9-00bc863e7e48 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.173527 May 09 09:48:44.140837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 110/213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:43 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:44.691395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:44.692084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:44.697954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:44.698391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:44.699148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:44.699573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:44.888490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:44.896104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-907af0cf-a6ea-4b29-a773-aa8cfb00d6f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.208903 May 09 09:48:44.896955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 104/214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:44 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:45.163141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:45.163758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:45.170005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:45.170449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:45.171270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:45.171697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:45.309128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:45.317334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d11136a-0e63-4ae8-b017-1930be465eaf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.160563 May 09 09:48:45.317914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 111/215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:45 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:45.912588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:45.913753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:45.920539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:45.921039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:45.922003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:45.922231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:46.058361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:46.065854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3af00731-b26b-412e-880d-09f4fa0f62f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.157421 May 09 09:48:46.066515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 105/216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:45 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:46.335808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:46.336343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:46.342966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:46.343406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:46.344174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:46.344624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:46.482358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:46.491521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04648b4d-cb58-4fa6-88eb-5da702031ab3 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.160073 May 09 09:48:46.492091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 112/217] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:46 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:47.089580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:47.090591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:47.101655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:47.102430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:47.103702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:47.104414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:47.259411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:47.271262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf725ceb-7ce0-4a75-ada9-ebdf9b7672d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.187895 May 09 09:48:47.272130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 106/218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:47 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:47.515502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:47.516506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:47.527041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:47.527786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:47.529166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:47.529855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:47.658527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:47.667097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d67e6b89-98e4-4978-8a07-14ead66d47d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.158197 May 09 09:48:47.667681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 113/219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:47 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:48.288496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:48.289126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:48.297612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:48.298234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:48.299407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:48.300016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:48.436353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:48.446284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0431f328-1cf3-498b-8430-a63f4460c82b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.161750 May 09 09:48:48.447303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 107/220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:48 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:48.688460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:48.689509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:48.699797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:48.700558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:48.701879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:48.702599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:48.833625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:48.841547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8bd3d39-db77-412d-a89c-f877b121beab tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.159605 May 09 09:48:48.842117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 114/221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:48 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:49.464634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:49.465368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:49.472693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:49.473212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:49.474108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:49.474615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:49.612384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:49.619913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5802182c-f3b0-47c7-856c-d2e0b97aace9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.159924 May 09 09:48:49.620570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 108/222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:49 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:49.858671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:49.859258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:49.866229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:49.866680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:49.867437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:49.867864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:50.005918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:50.013752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd585241-f3f5-4e84-9f99-8649186e4d3b tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.158989 May 09 09:48:50.014325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 115/223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:49 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:50.637257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:50.637897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:50.644420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:50.644911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:50.645673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:50.646110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:50.934640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:50.943079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e7a0e94-4299-482a-b3fe-f0305e14070c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.309695 May 09 09:48:50.957565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 109/224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:50 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:51.031024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:51.031773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:51.040553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:51.041161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:51.042031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:51.042575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:51.296153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:51.304456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96c0396e-fcb3-47b1-94ad-68e0c172de50 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1552 microversion: 2.1 time: 0.277328 May 09 09:48:51.305390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 116/225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:51 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1552 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:51.614283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-76826b6f-e83d-42a3-914c-7f4089b33a47 req-d1b816a0-02bf-4f37-90db-9612264394f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84adda1-a8c2-4797-8f59-a9a2d21eb25b", "name": "network-vif-deleted", "tag": "125310e8-6b4c-43ae-8571-626698644e8d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:48:51.626825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-76826b6f-e83d-42a3-914c-7f4089b33a47 req-d1b816a0-02bf-4f37-90db-9612264394f3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:51.627395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-76826b6f-e83d-42a3-914c-7f4089b33a47 req-d1b816a0-02bf-4f37-90db-9612264394f3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:51.639367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-76826b6f-e83d-42a3-914c-7f4089b33a47 req-d1b816a0-02bf-4f37-90db-9612264394f3 service nova] Creating event network-vif-deleted:125310e8-6b4c-43ae-8571-626698644e8d for instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b on hv-cinder-84108 May 09 09:48:51.644507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-76826b6f-e83d-42a3-914c-7f4089b33a47 req-d1b816a0-02bf-4f37-90db-9612264394f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034078 May 09 09:48:51.645142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 110/226] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:48:51.959796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:51.960705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:51.966847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:51.967296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:51.968048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:51.968497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:52.101058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:52.108436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ae630909-9ce3-4e21-87a3-f18981af777a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.152979 May 09 09:48:52.109080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 117/227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:51 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:52.322519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:52.323250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:52.329749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:52.330302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:52.331074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:52.331534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:52.392817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:52.401028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d74230da-19a7-4823-bf45-29d437911083 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1510 microversion: 2.1 time: 0.083071 May 09 09:48:52.411112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 111/228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:52 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:53.126088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:53.126819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:53.133074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:53.133518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:53.134285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:53.134711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:53.263833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:53.273031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-303d5f18-da40-4158-bb45-e67643976944 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.150414 May 09 09:48:53.273755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 118/229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:53 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:53.419988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:53.420590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:53.427565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:53.428013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:53.428919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:53.429244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:53.491603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:53.501687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1554877-750d-4660-991e-50bf204a5d84 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1510 microversion: 2.1 time: 0.085458 May 09 09:48:53.502433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 112/230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:53 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:54.292450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:54.294793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:54.307207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:54.307207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:54.307207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:54.307207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:54.449476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:54.458251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99204433-99d6-4e61-ba58-faf9adfc2330 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.172340 May 09 09:48:54.458825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 119/231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:54 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:54.519634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:54.520736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:54.528719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:54.529242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:54.529931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:54.530366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:54.594782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:54.606506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca1c5154-967a-44f6-bdad-b74bf049204e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1345 microversion: 2.1 time: 0.089145 May 09 09:48:54.606506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 113/232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:54 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:55.474985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:55.476243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:55.482246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:55.483187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:55.484129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:55.485074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:55.625318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:55.626519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:55.636738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:55.637186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:55.638498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:55.640600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:55.650610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:55.658684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-539ca3c6-300f-4c6c-86a5-56949e95c24d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.187474 May 09 09:48:55.659258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 120/233] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:55 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:55.731280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:55.738983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3994332c-e763-4c8a-9ec2-1bf4973a54cf tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1345 microversion: 2.1 time: 0.117390 May 09 09:48:55.739742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 114/234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:55 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:48:56.679550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:56.680487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:56.690564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:56.691628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:56.693639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:56.694454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:56.756083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:56.757475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:56.763712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:56.764119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:56.765176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:56.765709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:56.836760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:56.838573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40cb55020f07488c9c344541d895ec1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153cae04bb6b46d0a52c15411f0c4720', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:56.844351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-352cb0bd-8a47-4671-b3a4-e4cf7c5887af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.171107 May 09 09:48:56.844996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 121/235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:56 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:56.846753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1e97f079-b27e-4e13-987f-94c2f8b51ba6 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 200 len: 1345 microversion: 2.1 time: 0.094604 May 09 09:48:56.847313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 115/236] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:56 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:57.862040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:57.862647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:57.863603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:57.864302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:57.869666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:57.870437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:57.871606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:57.872094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:57.872362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:57.872542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:57.873625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:57.874192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:57.890896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] HTTP exception thrown: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Request method failure captured: May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b HTTP/1.1 May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMkV4MiNqjyAwbIZZzbEHAL0U0DM6oPMdjgjH2t5_xbdyXLdrzQ2FMnKEiVy_19S1wpGqaq9V4N7-D5qWrDSAwuVlcOECL9lLTdUYfdJdMBL4JNzE2PRc9KZ2Vz0bN1D77O05uYf_y0bMOO7XKpMkCQ2sjvTQAEXnl5iKtvCt4rNoA May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:48:57.896380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_153cae04bb6b46d0a52c15411f0c4720", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-DeleteServersTestJSON-236243428 May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 40cb55020f07488c9c344541d895ec1c May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:57.897870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'd84adda1-a8c2-4797-8f59-a9a2d21eb25b'} May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:48:57.898587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:57.901352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:57.902877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Returning 404 to user: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:48:57.902877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf2bde2b-782a-486e-9195-76d082389cbb tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 404 len: 111 microversion: 2.1 time: 0.038720 May 09 09:48:57.902877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 116/237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:57 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:48:58.003806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:58.004844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:58.010055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:58.011328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:58.011874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:58.012721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:58.013219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:58.017825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d24eebd-02c1-454c-b2c8-d1912b19bbad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.160233 May 09 09:48:58.018413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 122/238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:57 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:58.028330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] HTTP exception thrown: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Request method failure captured: May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b/os-volume_attachments HTTP/1.1 May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMkV4MiNqjyAwbIZZzbEHAL0U0DM6oPMdjgjH2t5_xbdyXLdrzQ2FMnKEiVy_19S1wpGqaq9V4N7-D5qWrDSAwuVlcOECL9lLTdUYfdJdMBL4JNzE2PRc9KZ2Vz0bN1D77O05uYf_y0bMOO7XKpMkCQ2sjvTQAEXnl5iKtvCt4rNoA May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:48:58.030194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_153cae04bb6b46d0a52c15411f0c4720", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-DeleteServersTestJSON-236243428 May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 40cb55020f07488c9c344541d895ec1c May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:58.031462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'd84adda1-a8c2-4797-8f59-a9a2d21eb25b'} May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:48:58.032140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:58.033445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:58.034564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Returning 404 to user: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:48:58.034564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-102b8169-7729-4676-84a9-f8fd9ba0a48e tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032053 May 09 09:48:58.034564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 117/239] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 09:48:57 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 09:48:59.035539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:59.036289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:59.043503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:59.043949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:59.044752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:59.045180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:59.185811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:48:59.194293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9aae8780-6ea9-4215-94dd-cc2a3347c576 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.162822 May 09 09:48:59.195089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 123/240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:59 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:48:59.245514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:59.246258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:59.253083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:59.253530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:59.254311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:59.254730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:59.268756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] HTTP exception thrown: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Request method failure captured: May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b HTTP/1.1 May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMkV4MiNqjyAwbIZZzbEHAL0U0DM6oPMdjgjH2t5_xbdyXLdrzQ2FMnKEiVy_19S1wpGqaq9V4N7-D5qWrDSAwuVlcOECL9lLTdUYfdJdMBL4JNzE2PRc9KZ2Vz0bN1D77O05uYf_y0bMOO7XKpMkCQ2sjvTQAEXnl5iKtvCt4rNoA May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:48:59.270353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_153cae04bb6b46d0a52c15411f0c4720", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-DeleteServersTestJSON-236243428 May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 40cb55020f07488c9c344541d895ec1c May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.271952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'd84adda1-a8c2-4797-8f59-a9a2d21eb25b'} May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:48:59.272772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.274097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:48:59.275882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Returning 404 to user: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:48:59.275882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2a2a2b54-ae70-463f-af52-9eb14aa7dd1f tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 404 len: 111 microversion: 2.1 time: 0.030349 May 09 09:48:59.275882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 118/241] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 09:48:59 2022] DELETE /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:48:59.287724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:48:59.288338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] [instance: d84adda1-a8c2-4797-8f59-a9a2d21eb25b] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:48:59.295589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:59.296302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:59.297384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:48:59.297938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:48:59.312696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] HTTP exception thrown: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Request method failure captured: May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b HTTP/1.1 May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMkV4MiNqjyAwbIZZzbEHAL0U0DM6oPMdjgjH2t5_xbdyXLdrzQ2FMnKEiVy_19S1wpGqaq9V4N7-D5qWrDSAwuVlcOECL9lLTdUYfdJdMBL4JNzE2PRc9KZ2Vz0bN1D77O05uYf_y0bMOO7XKpMkCQ2sjvTQAEXnl5iKtvCt4rNoA May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:48:59.317379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/153cae04bb6b46d0a52c15411f0c4720"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_153cae04bb6b46d0a52c15411f0c4720", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-DeleteServersTestJSON-236243428 May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 153cae04bb6b46d0a52c15411f0c4720 May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-DeleteServersTestJSON-236243428 May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 40cb55020f07488c9c344541d895ec1c May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-DeleteServersTestJSON-236243428-project May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.318672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'd84adda1-a8c2-4797-8f59-a9a2d21eb25b'} May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:48:59.319428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. May 09 09:48:59.320492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:48:59.321991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] Returning 404 to user: Instance d84adda1-a8c2-4797-8f59-a9a2d21eb25b could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:48:59.321991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8823dc8d-42ef-4a63-972d-d540e4e174d7 tempest-DeleteServersTestJSON-236243428 tempest-DeleteServersTestJSON-236243428-project] 10.222.0.26 "GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b" status: 404 len: 111 microversion: 2.1 time: 0.035460 May 09 09:48:59.321991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 124/242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:48:59 2022] GET /compute/v2.1/servers/d84adda1-a8c2-4797-8f59-a9a2d21eb25b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:49:00.211292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:00.211902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:00.218404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:00.218906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:00.219673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:00.220147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:00.353549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:00.362091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc9fdc5b-2db0-4573-8b69-d069455d8aa8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.154929 May 09 09:49:00.362665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 119/243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:00 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:01.274949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9dfcd0c-4357-4a3b-83d9-9052143d1614 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Action: 'create', calling method: .version_select at 0x7fa46403fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-159211567"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:49:01.379954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:01.381656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:01.388825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:01.389272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:01.390034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:01.390460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:01.525888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:01.534364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5912f51c-ba69-4f2e-8ee9-20b22dbe72b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.158455 May 09 09:49:01.544171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 120/244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:01 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:01.597873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9dfcd0c-4357-4a3b-83d9-9052143d1614 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.444757 May 09 09:49:01.598723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 125/245] 10.222.0.26 () {60 vars in 1154 bytes} [Mon May 9 09:49:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 446 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 09:49:01.609967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79020e2f-fa04-4d90-b5eb-0b70c424a3ab tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efbce50>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:01.659057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79020e2f-fa04-4d90-b5eb-0b70c424a3ab tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.053183 May 09 09:49:01.659641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 121/246] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:01 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:02.552052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:02.552644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:02.559627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:02.559976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:02.560790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:02.561218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:02.672245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f200a7b-36e7-4639-a2c7-fe5c44ed1217 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa46534a3a0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:02.699238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:02.707149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-67cc357e-4777-4f0a-99ac-3e12cabee70c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.159083 May 09 09:49:02.718002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 126/247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:02 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:02.723914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f200a7b-36e7-4639-a2c7-fe5c44ed1217 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.052275 May 09 09:49:02.723914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 122/248] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:02 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:03.723704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:03.724283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:03.731321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:03.732318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:03.732485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:03.732960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:03.734728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c32247f-79e7-4b92-9d45-d4eb0e3f2061 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb94c0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:03.796468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c32247f-79e7-4b92-9d45-d4eb0e3f2061 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.066608 May 09 09:49:03.797510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 123/249] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:03 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:04.041779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:04.049452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15e4006a-0a77-48c5-8344-d7a7d0bde2bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.329666 May 09 09:49:04.050025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 127/250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:03 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:04.811519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0064168b-fbd3-4e74-8b37-43249e4a72d7 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa4640be160>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:04.876013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0064168b-fbd3-4e74-8b37-43249e4a72d7 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.069534 May 09 09:49:04.876584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 124/251] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:04 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:05.067170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:05.067765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:05.075193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:05.075635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:05.076409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:05.076875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:05.218651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:05.230253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8267f88-a817-433c-a3b0-b2224899ca48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.167063 May 09 09:49:05.231056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 128/252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:05 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:05.889795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cccf33e1-16cd-42ee-b301-1282ae9e95bb tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb13a0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:05.939478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cccf33e1-16cd-42ee-b301-1282ae9e95bb tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.054409 May 09 09:49:05.940102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 125/253] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:05 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:06.252207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:06.253014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:06.261863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:06.262307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:06.263089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:06.263495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:06.422508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:06.430499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb217d01-81d3-4ee7-be35-0f7b1e90fa27 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.182528 May 09 09:49:06.431166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 129/254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:06 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:06.956280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e247392-7b15-47c8-bb80-4e0a74c3a3b2 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb9ca0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:07.010487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e247392-7b15-47c8-bb80-4e0a74c3a3b2 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.062026 May 09 09:49:07.011067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 126/255] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:06 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:07.447817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:07.448422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:07.456577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:07.457280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:07.458527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:07.459198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:07.615874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:07.624366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04a7030c-2b25-4235-a6cb-6dda7c986ddc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.180446 May 09 09:49:07.624993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 130/256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:07 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:08.024507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b00dbe13-0b7c-4a06-9c3f-70c1a5a3eb89 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efbcca0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:08.077769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b00dbe13-0b7c-4a06-9c3f-70c1a5a3eb89 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.057883 May 09 09:49:08.078340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 127/257] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:08 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:08.646369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:08.647226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:08.657065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:08.657855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:08.659044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:08.659644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:08.815818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:08.825527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5d86b374-942b-4c01-af86-050e06f147bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.184705 May 09 09:49:08.826288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 131/258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:08 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:09.092226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1a0fa3e-87c6-476e-99d1-56db036d4319 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa46534a3a0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:09.138849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1a0fa3e-87c6-476e-99d1-56db036d4319 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.051557 May 09 09:49:09.139430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 128/259] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:09 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:09.849497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:09.850580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:09.862011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:09.862757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:09.864040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:09.864798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:10.016694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:10.025582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98e8ade2-f604-44d5-bfe8-96a8d9e68e4f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.182724 May 09 09:49:10.026151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 132/260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:09 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:10.152191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1a03a8a-7d22-4dcd-a2d0-c1af64a8b615 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb7700>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:10.200094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1a03a8a-7d22-4dcd-a2d0-c1af64a8b615 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.052282 May 09 09:49:10.200697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 129/261] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:10 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:11.047571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:11.048540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:11.058638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:11.059111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:11.059856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:11.060281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:11.192440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:11.203652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f3d0887-2181-4ebe-878e-f8d37aa5bdb2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.162976 May 09 09:49:11.204577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 133/262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:11 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:11.214312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6efd646-fc15-45d0-9807-fa388959df33 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa464051a60>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:11.260691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6efd646-fc15-45d0-9807-fa388959df33 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.051206 May 09 09:49:11.261330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 130/263] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:11 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:12.220956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:12.221537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:12.228396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:12.228877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:12.229750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:12.230206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:12.275324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1d16164-078b-4ae7-b31c-083db201a4c7 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb13a0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:12.324609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1d16164-078b-4ae7-b31c-083db201a4c7 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.054986 May 09 09:49:12.325269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 131/264] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:12 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:12.362639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:12.373872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-77309a78-ba8b-4e62-bc29-b653aa19c077 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.156526 May 09 09:49:12.374573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 134/265] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:12 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:13.342891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2902102-f81b-41d0-ae3a-2805e9b43d67 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb1040>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:13.391259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:13.391872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:13.398109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:13.398558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:13.399315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:13.399743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:13.401112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2902102-f81b-41d0-ae3a-2805e9b43d67 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.065950 May 09 09:49:13.401695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 132/266] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:13 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:13.538530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:13.546572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c47dac91-bbbb-4c3c-8c9a-3e782887fc88 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.159415 May 09 09:49:13.547129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 135/267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:13 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:14.415350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42c04905-fa9d-4b94-b177-3ac14a28b0b4 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa4640be280>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:14.460830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42c04905-fa9d-4b94-b177-3ac14a28b0b4 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.050220 May 09 09:49:14.461366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 133/268] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:14 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:14.565107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:14.567089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:14.573766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:14.574250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:14.575149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:14.575441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:14.709785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:14.720844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c5a59fef-59ea-48ba-941a-122f6fd6fedc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.160778 May 09 09:49:14.721404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 136/269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:14 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:15.474576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec997645-8ffe-4c18-aea6-5e19f29c4b39 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb7790>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:15.524166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec997645-8ffe-4c18-aea6-5e19f29c4b39 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 345 microversion: 2.1 time: 0.054298 May 09 09:49:15.524780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 134/270] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:15 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:15.539999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc937a3b-4545-4863-9259-6fbb07b7c555 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Action: 'create', calling method: .version_select at 0x7fa4642eb5e0>, body: {"snapshot": {"volume_id": "413faff8-5b42-465d-beca-9c3cb5fdce87", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-999690106"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:49:15.700029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc937a3b-4545-4863-9259-6fbb07b7c555 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.163898 May 09 09:49:15.700871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 137/271] 10.222.0.26 () {60 vars in 1161 bytes} [Mon May 9 09:49:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:15.714578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea5c8a88-97b2-4085-9fbe-5a64dce9a782 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45ef40310>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:15.739086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:15.739863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:15.746199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:15.746712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:15.747501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:15.747681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea5c8a88-97b2-4085-9fbe-5a64dce9a782 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.040614 May 09 09:49:15.747949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:15.748270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 135/272] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:15 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:15.757722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8668ed71-e7c1-4ec8-ad32-08eb59489ef9 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb9af0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:15.786023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8668ed71-e7c1-4ec8-ad32-08eb59489ef9 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.031849 May 09 09:49:15.786666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 136/273] 10.222.0.26 () {58 vars in 1139 bytes} [Mon May 9 09:49:15 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:15.796654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-80653b8a-3600-4ba3-b5a6-53abe1143600 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb94c0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:15.824887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-80653b8a-3600-4ba3-b5a6-53abe1143600 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.031921 May 09 09:49:15.825483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 137/274] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:15 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:15.903343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:15.910848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d6e7d226-6883-4921-9a93-0e09a8d98b80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.175886 May 09 09:49:15.911388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 138/275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:15 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:16.837706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a75f8fbd-0f4e-46fc-b9c7-7deeb268404e tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa464109b80>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:16.869718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a75f8fbd-0f4e-46fc-b9c7-7deeb268404e tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.036607 May 09 09:49:16.870298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 138/276] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:16 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:16.928247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:16.928899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:16.935548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:16.936000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:16.936820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:16.937247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:17.074754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:17.083129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2febb0f1-bf19-43f3-8982-1638b477c4bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.158914 May 09 09:49:17.083710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 139/277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:16 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:17.885716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70d4e8f1-8ebc-424c-a37f-88653740b581 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb90d0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:17.917304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70d4e8f1-8ebc-424c-a37f-88653740b581 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.038491 May 09 09:49:17.918031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 139/278] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:17 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:18.100341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:18.100991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:18.107534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:18.107985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:18.109189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:18.109626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:18.247676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:18.255437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5156091f-54d4-4fe9-818d-714cb9d3271e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.159443 May 09 09:49:18.255966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 140/279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:18 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:18.933961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5379c06-2be7-4b20-9be6-70450ed51cce tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa4640e7f70>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:18.967625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5379c06-2be7-4b20-9be6-70450ed51cce tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.040562 May 09 09:49:18.968215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 140/280] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:18 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:19.276563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:19.277576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:19.284824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:19.285231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:19.286061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:19.286493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:19.417826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:19.426160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a413deb-3c7f-409f-97ad-12fd764c51cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.156498 May 09 09:49:19.426739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 141/281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:19 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:19.979886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-638e6020-bff3-49eb-81a3-ced6c2c71b6a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45ef40d30>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:20.009210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-638e6020-bff3-49eb-81a3-ced6c2c71b6a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.033536 May 09 09:49:20.009775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 141/282] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:19 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:20.449937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:20.450907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:20.459187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:20.459636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:20.460404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:20.460869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:20.601330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:20.609283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f654e8d-69e6-484b-ae0d-543e7d786933 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.168306 May 09 09:49:20.609859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 142/283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:20 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:21.024922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d0cc154-07bf-4a20-8cbd-d266d7426307 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb9af0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:21.055178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d0cc154-07bf-4a20-8cbd-d266d7426307 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.036833 May 09 09:49:21.055730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 142/284] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:21 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:21.626486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:21.627258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:21.634162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:21.634355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:21.635141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:21.635573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:21.778536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:21.786816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-525cb94b-9f7c-4866-89e6-73da4bc154cf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.164354 May 09 09:49:21.787444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 143/285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:21 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:22.067493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bbcbbae-05ee-4c27-9444-2d4c065b8dd8 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb99d0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:22.096721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bbcbbae-05ee-4c27-9444-2d4c065b8dd8 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.033445 May 09 09:49:22.097304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 143/286] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:22 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:22.807534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:22.808541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:22.819135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:22.819791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:22.821112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:22.821868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:22.959188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:22.969312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48481a65-2869-4cf9-b5ca-bd9dc47e0c89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.168435 May 09 09:49:22.969850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 144/287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:22 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:23.109953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-baade48a-7078-4631-a0d1-260cc3d0dde1 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa4640a4550>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:23.141403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-baade48a-7078-4631-a0d1-260cc3d0dde1 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.036335 May 09 09:49:23.141939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 144/288] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:23 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:23.986863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:23.987473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:23.993874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:23.994321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:23.995093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:23.995526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:24.126252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:24.134394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e7e5f4e-c69e-41f5-9038-c361e2e4e4b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.151708 May 09 09:49:24.134971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 145/289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:23 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:24.153836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df00d484-6d0c-4614-92ef-13c249df1e65 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb9ee0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:24.182603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df00d484-6d0c-4614-92ef-13c249df1e65 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.033075 May 09 09:49:24.183166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 145/290] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:24 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:25.155744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:25.156313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:25.162811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:25.163267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:25.164040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:25.164480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:25.194810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-166fdbd3-9bd7-432f-b596-31a6848486c3 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45ef40550>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:25.227310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-166fdbd3-9bd7-432f-b596-31a6848486c3 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 287 microversion: 2.1 time: 0.036661 May 09 09:49:25.227915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:25 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:25.238023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54461786-17cb-4d5e-a3b5-2f42777f3165 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa4640a48b0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:25.294182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54461786-17cb-4d5e-a3b5-2f42777f3165 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 202 len: 0 microversion: 2.1 time: 0.059697 May 09 09:49:25.294787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 147/292] 10.222.0.26 () {58 vars in 1253 bytes} [Mon May 9 09:49:25 2022] DELETE /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:49:25.297994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:25.303590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fde13666-9e40-4f2d-8e84-d9541dec5b3b tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45ef40670>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:25.305799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5a08b55-5435-42a1-ad61-9fb93c4bdb8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.156801 May 09 09:49:25.306388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 146/293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:25 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:25.332385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fde13666-9e40-4f2d-8e84-d9541dec5b3b tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.032782 May 09 09:49:25.332996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 148/294] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:25 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:26.325454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:26.326107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:26.333325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:26.333765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:26.334546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:26.335198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:26.343593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-edfea416-10b1-4fad-8818-6b1dfc709c32 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb9550>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:26.375913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-edfea416-10b1-4fad-8818-6b1dfc709c32 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 200 len: 286 microversion: 2.1 time: 0.036141 May 09 09:49:26.380487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 149/295] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:26 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:26.489197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:26.498597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ecc9982d-7ef3-483a-9759-2b373ad8ef99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.179559 May 09 09:49:26.499207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 147/296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:26 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:27.393206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc7e2ea9-3f94-43f7-9126-d81184134847 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa4640a4dc0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:27.422757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-fc7e2ea9-3f94-43f7-9126-d81184134847 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] HTTP exception thrown: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc7e2ea9-3f94-43f7-9126-d81184134847 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Request method failure captured: May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 HTTP/1.1 May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOONCfnedHbY-OgTh6KQzoPOmoul-fXuWye2eusRXVKYAxK9GjR5fqLLXUD67Gv52Br-2NmT7X2Cn-hAAVlqCPHuRNWP99eXwQYg5c3MK_0qqICsVvUZTnIKZr2SPxT5SmK-NlKZcTpApLCyLHSrKskzXvj99sSla53Q5yqcqzB8jLw May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:49:27.424994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e79a219bf03c403aa5d25f0f633f324c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cf1c6e68a1ea45ce9e390f07cf7cf505 May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'dee710a7-18c1-4ae1-bc03-e5a166075742'} May 09 09:49:27.426289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. (HTTP 404) (Request-ID: req-e2e3c9d8-a95d-409b-8502-5b31c92817d2) May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.427079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:49:27.428176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 09 09:49:27.429480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc7e2ea9-3f94-43f7-9126-d81184134847 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Returning 404 to user: Snapshot dee710a7-18c1-4ae1-bc03-e5a166075742 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc7e2ea9-3f94-43f7-9126-d81184134847 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742" status: 404 len: 111 microversion: 2.1 time: 0.040600 May 09 09:49:27.430922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 150/297] 10.222.0.26 () {58 vars in 1250 bytes} [Mon May 9 09:49:27 2022] GET /compute/v2.1/os-snapshots/dee710a7-18c1-4ae1-bc03-e5a166075742 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:49:27.435099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6c6768c-34fd-4ad5-9ead-8643d55bb1de tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45effa550>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:27.495948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6c6768c-34fd-4ad5-9ead-8643d55bb1de tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 202 len: 0 microversion: 2.1 time: 0.064633 May 09 09:49:27.496592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 148/298] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 09:49:27 2022] DELETE /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:49:27.505249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e63ff1b2-daff-4fa5-bf2a-23abf71aae2f tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb93a0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:27.515992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:27.516852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:27.524321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:27.524756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:27.525599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:27.526042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:27.554669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e63ff1b2-daff-4fa5-bf2a-23abf71aae2f tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.053220 May 09 09:49:27.555423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 151/299] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:27 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:27.741829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:27.750009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-435aee8e-799b-4475-9e74-811d93101d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1522 microversion: 2.1 time: 0.238292 May 09 09:49:27.750603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 149/300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:27 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:28.571237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6cad416-29ec-44c6-901b-5a3a04de578e tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45ef40ee0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:28.624311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6cad416-29ec-44c6-901b-5a3a04de578e tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 200 len: 344 microversion: 2.1 time: 0.060171 May 09 09:49:28.625150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 152/301] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:28 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:28.767521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:28.768155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:28.774827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:28.775282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:28.776039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:28.776481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:28.907595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:28.915089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ec1bd899-977c-46fe-9daa-7b1f413d5a1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1502 microversion: 2.1 time: 0.151822 May 09 09:49:28.915653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 150/302] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:28 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:28.930871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:28.931477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:28.937865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:28.938315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:28.939080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:28.939514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:29.079376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:29.086792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10349615-052e-4a87-ba5d-dacf787d20fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1516 microversion: 2.1 time: 0.159814 May 09 09:49:29.087349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 153/303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:28 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:29.639098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af4b6b75-3a78-485a-9bc6-cd7304508044 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa46417a940>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:29.670635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-af4b6b75-3a78-485a-9bc6-cd7304508044 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] HTTP exception thrown: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af4b6b75-3a78-485a-9bc6-cd7304508044 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Request method failure captured: May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 HTTP/1.1 May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOONCfnedHbY-OgTh6KQzoPOmoul-fXuWye2eusRXVKYAxK9GjR5fqLLXUD67Gv52Br-2NmT7X2Cn-hAAVlqCPHuRNWP99eXwQYg5c3MK_0qqICsVvUZTnIKZr2SPxT5SmK-NlKZcTpApLCyLHSrKskzXvj99sSla53Q5yqcqzB8jLw May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:49:29.674454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e79a219bf03c403aa5d25f0f633f324c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: cf1c6e68a1ea45ce9e390f07cf7cf505 May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '413faff8-5b42-465d-beca-9c3cb5fdce87'} May 09 09:49:29.675932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. (HTTP 404) (Request-ID: req-8e06cd29-f76c-4167-8d74-763731f7f204) May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.676806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:49:29.678069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 09:49:29.679261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af4b6b75-3a78-485a-9bc6-cd7304508044 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Returning 404 to user: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af4b6b75-3a78-485a-9bc6-cd7304508044 tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 404 len: 109 microversion: 2.1 time: 0.041945 May 09 09:49:29.680362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 151/304] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:29 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 09:49:29.686342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102f656d-a171-45a4-a391-2f36fadcd02c tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45efb94c0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:29.713948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-102f656d-a171-45a4-a391-2f36fadcd02c tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] HTTP exception thrown: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102f656d-a171-45a4-a391-2f36fadcd02c tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Request method failure captured: May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 HTTP/1.1 May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOONCfnedHbY-OgTh6KQzoPOmoul-fXuWye2eusRXVKYAxK9GjR5fqLLXUD67Gv52Br-2NmT7X2Cn-hAAVlqCPHuRNWP99eXwQYg5c3MK_0qqICsVvUZTnIKZr2SPxT5SmK-NlKZcTpApLCyLHSrKskzXvj99sSla53Q5yqcqzB8jLw May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:49:29.715911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e79a219bf03c403aa5d25f0f633f324c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cf1c6e68a1ea45ce9e390f07cf7cf505 May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '413faff8-5b42-465d-beca-9c3cb5fdce87'} May 09 09:49:29.717228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. (HTTP 404) (Request-ID: req-e0c121a3-db3a-4d4d-b6dc-428846721702) May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.718041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 09 09:49:29.719163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 09 09:49:29.720167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102f656d-a171-45a4-a391-2f36fadcd02c tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Returning 404 to user: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-102f656d-a171-45a4-a391-2f36fadcd02c tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 404 len: 109 microversion: 2.1 time: 0.034908 May 09 09:49:29.721222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 154/305] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 09:49:29 2022] DELETE /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:49:29.725919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd0bee00-c098-4fb1-8fe5-79907e486a4a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Calling method '.version_select at 0x7fa45effaaf0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:29.756134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-dd0bee00-c098-4fb1-8fe5-79907e486a4a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] HTTP exception thrown: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd0bee00-c098-4fb1-8fe5-79907e486a4a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Request method failure captured: May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 HTTP/1.1 May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOONCfnedHbY-OgTh6KQzoPOmoul-fXuWye2eusRXVKYAxK9GjR5fqLLXUD67Gv52Br-2NmT7X2Cn-hAAVlqCPHuRNWP99eXwQYg5c3MK_0qqICsVvUZTnIKZr2SPxT5SmK-NlKZcTpApLCyLHSrKskzXvj99sSla53Q5yqcqzB8jLw May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:49:29.758228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e79a219bf03c403aa5d25f0f633f324c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e79a219bf03c403aa5d25f0f633f324c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: e79a219bf03c403aa5d25f0f633f324c May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-607748380 May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: cf1c6e68a1ea45ce9e390f07cf7cf505 May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesSnapshotsTestJSON-607748380-project May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '413faff8-5b42-465d-beca-9c3cb5fdce87'} May 09 09:49:29.759595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. (HTTP 404) (Request-ID: req-2ca0fdc4-b56b-4f6b-9c08-bc4773013a7a) May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.760481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 09:49:29.761875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 09:49:29.763504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd0bee00-c098-4fb1-8fe5-79907e486a4a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] Returning 404 to user: Volume 413faff8-5b42-465d-beca-9c3cb5fdce87 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd0bee00-c098-4fb1-8fe5-79907e486a4a tempest-VolumesSnapshotsTestJSON-607748380 tempest-VolumesSnapshotsTestJSON-607748380-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87" status: 404 len: 109 microversion: 2.1 time: 0.037478 May 09 09:49:29.765020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 152/306] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:29 2022] GET /compute/v2.1/os-volumes/413faff8-5b42-465d-beca-9c3cb5fdce87 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:49:31.321685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2069741813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-199242016", "security_groups": [{"name": "tempest-secgroup-smoke-785039601"}], "block_device_mapping_v2": [{"uuid": "0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff83fa46-d09c-4426-9a64-8ad4e2ae8c64"}]}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:49:31.431962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] validate_networks() for [('ff83fa46-d09c-4426-9a64-8ad4e2ae8c64', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:49:31.490576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:49:31.492830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:31.499834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:31.500647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:31.501758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:31.502416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:31.528634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'flavor' on Instance uuid 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:49:31.609906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6bce54c-9d8f-46fd-ab47-c3be0b1b0524 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/action" status: 200 len: 32 microversion: 2.1 time: 0.122979 May 09 09:49:31.611320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 153/307] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:49:31 2022] POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/action => generated 32 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 09:49:31.626199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:31.626199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:31.633713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:31.634331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:31.635229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:31.635773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:31.845633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:31.852938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d660bc25-4512-428e-a8b1-a45535136bd4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.235505 May 09 09:49:31.853476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 154/308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:31 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:32.083692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:49:32.084465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:49:32.085462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:49:32.086014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:49:32.086630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:49:32.095447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:32.095877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:32.096909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:32.097314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:32.114942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for project 39c36cb22c2846e480c26840635bf29c. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:49:32.119243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for user 1c091a71e2ad46ceafe25be874c016a6 and project 39c36cb22c2846e480c26840635bf29c. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:49:32.182165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:49:32.186871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d',volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:49:32.336301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1eb87f32-7f23-4640-a34a-8a3ad387a170 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.020305 May 09 09:49:32.337818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 155/309] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:49:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:49:32.348307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-24350931-2499-4992-880d-79c9ec5fcdd4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:32.348969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-24350931-2499-4992-880d-79c9ec5fcdd4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:32.405644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-24350931-2499-4992-880d-79c9ec5fcdd4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:32.413192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-24350931-2499-4992-880d-79c9ec5fcdd4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1094 microversion: 2.1 time: 0.068839 May 09 09:49:32.421335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 155/310] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:32 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:32.875150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:32.876368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:32.886941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:32.887801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:32.889589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:32.890148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:33.047297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:33.054535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eac198f7-324c-443b-8758-feb79ce9a701 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.186774 May 09 09:49:33.055031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 156/311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:32 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:33.430036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:33.430866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:33.438726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:33.444389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:33.445595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:33.446210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:33.546662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:33.557065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d70c0d3-cf81-414b-9979-1f3bc59539f5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1200 microversion: 2.1 time: 0.131084 May 09 09:49:33.557847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 156/312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:33 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1200 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:33.822929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-da485103-22c7-4a9b-9f2b-0b927e8e00b3 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef46a60>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:33.871015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-da485103-22c7-4a9b-9f2b-0b927e8e00b3 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/bc39e164-74cb-4142-89b8-0478ad699219" status: 200 len: 348 microversion: 2.1 time: 0.052544 May 09 09:49:33.871730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 157/313] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:33 2022] GET /compute/v2.1/os-volumes/bc39e164-74cb-4142-89b8-0478ad699219 => generated 348 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:34.071979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:34.072873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:34.079831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:34.080610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:34.081511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:34.082192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:34.380766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:34.398426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8da70455-dc11-4b9f-b3fa-36f63fb1bc4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.330777 May 09 09:49:34.399629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 157/314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:34 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:34.573704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:34.574658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:34.581333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:34.582036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:34.583158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:34.583599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:34.751432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:34.759423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1d3ac38-0589-45e6-b417-7fd7a27890ff tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.189392 May 09 09:49:34.760202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 158/315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:34 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:35.106357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-e45242bc-09d0-4158-acbc-ec0c3245c4f3 req-435aaa41-de52-474b-934b-44c3d941643a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2554f24-99b6-4ba6-91e9-9ec6289fbda0", "tag": "d72de17a-e8f0-4642-9de8-3696406e4a3f"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:49:35.115050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-e45242bc-09d0-4158-acbc-ec0c3245c4f3 req-435aaa41-de52-474b-934b-44c3d941643a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:35.115731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-e45242bc-09d0-4158-acbc-ec0c3245c4f3 req-435aaa41-de52-474b-934b-44c3d941643a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:35.131584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-e45242bc-09d0-4158-acbc-ec0c3245c4f3 req-435aaa41-de52-474b-934b-44c3d941643a service nova] Creating event network-changed:d72de17a-e8f0-4642-9de8-3696406e4a3f for instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 on hv-cinder-84108 May 09 09:49:35.136454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-e45242bc-09d0-4158-acbc-ec0c3245c4f3 req-435aaa41-de52-474b-934b-44c3d941643a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033983 May 09 09:49:35.137412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 158/316] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:35.415445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:35.416031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:35.422591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:35.423013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:35.423779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:35.424213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:35.551789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:35.559447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7890ae6-5d0e-4e87-8476-e8056b70a4d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.147840 May 09 09:49:35.560150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 159/317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:35 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:35.780309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:35.781386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:35.789941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:35.790533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:35.791744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:35.792390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:35.928104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:35.935707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d2190f0-6437-48a8-b4a8-ae75a5d737ea tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.162213 May 09 09:49:35.936269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 159/318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:35 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:36.290868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09bd314e-b441-4da9-9d42-be872250bb5d tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa4640a4700>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:36.338515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09bd314e-b441-4da9-9d42-be872250bb5d tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab5231f4-ac6e-415c-9c70-4ffed929be34" status: 200 len: 350 microversion: 2.1 time: 0.051589 May 09 09:49:36.339094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 160/319] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:36 2022] GET /compute/v2.1/os-volumes/ab5231f4-ac6e-415c-9c70-4ffed929be34 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:36.577267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:36.577873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:36.584080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:36.584512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:36.586006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:36.586117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:36.718994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:36.726591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dee6868d-7f23-4a8d-8ecf-42b0b1683761 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.153343 May 09 09:49:36.727154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 160/320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:36 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:36.957221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:36.958141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:36.968492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:36.969321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:36.970316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:36.970742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:37.103580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:37.112226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-32f619a8-6df1-4ef0-835a-8d4a7499fabe tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.162218 May 09 09:49:37.112821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 161/321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:36 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:37.750825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:37.751855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:37.762584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:37.763340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:37.764628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:37.765387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:37.902665 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:37.910631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-421380e2-f13a-48f2-b65f-54e23d16ab85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.166453 May 09 09:49:37.911204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 161/322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:37 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:38.131144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:38.131732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:38.138666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:38.139301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:38.139886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:38.140327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:38.281086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:38.288901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9cfc53ac-1b64-438a-8cb8-8d194a757fc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.161759 May 09 09:49:38.289523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 162/323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:38 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:38.746053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68103cb4-495d-41fe-9c23-e33e95f1d9ac tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45efdbdc0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:38.805209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68103cb4-495d-41fe-9c23-e33e95f1d9ac tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cdf98bdd-810d-44ce-8488-6835c12f4302" status: 200 len: 351 microversion: 2.1 time: 0.062947 May 09 09:49:38.805818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 162/324] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 09:49:38 2022] GET /compute/v2.1/os-volumes/cdf98bdd-810d-44ce-8488-6835c12f4302 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:38.817000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8da353b2-243a-4f44-997a-96430972051b tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef408b0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:38.896803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8da353b2-243a-4f44-997a-96430972051b tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.083539 May 09 09:49:38.897367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 163/325] 10.222.0.26 () {58 vars in 1133 bytes} [Mon May 9 09:49:38 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:38.909961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf332e67-a036-4297-92cb-b4691ea7ffe3 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa46415a820>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:38.927946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:38.928573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:38.934902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:38.935351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:38.936127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:38.936560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:38.989639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf332e67-a036-4297-92cb-b4691ea7ffe3 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083493 May 09 09:49:38.990215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 163/326] 10.222.0.26 () {58 vars in 1148 bytes} [Mon May 9 09:49:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:39.001749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6282326c-2197-4771-bdaf-f6f9db11f2d7 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef940d0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.066818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:39.074517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d903661-5b68-4367-ad7d-b8578be9c185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.150665 May 09 09:49:39.075056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 164/327] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:38 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:39.080822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6282326c-2197-4771-bdaf-f6f9db11f2d7 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.082814 May 09 09:49:39.081533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 164/328] 10.222.0.26 () {58 vars in 1133 bytes} [Mon May 9 09:49:38 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:39.092261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39e7bb3f-e06c-45c2-af5f-3f68d9b618d0 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef404c0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.174024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39e7bb3f-e06c-45c2-af5f-3f68d9b618d0 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085368 May 09 09:49:39.174644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 165/329] 10.222.0.26 () {58 vars in 1166 bytes} [Mon May 9 09:49:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:49:39.186393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6766a844-fbb3-48e2-b021-58c4c1e145c5 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45efdbca0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.264202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6766a844-fbb3-48e2-b021-58c4c1e145c5 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081561 May 09 09:49:39.264792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 165/330] 10.222.0.26 () {58 vars in 1169 bytes} [Mon May 9 09:49:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:39.278507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb630085-cf8f-4668-bdef-6db947a777d3 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef46280>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.306139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.306851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:39.313298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:39.313751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:39.314559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:39.315134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:39.357790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb630085-cf8f-4668-bdef-6db947a777d3 tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.084117 May 09 09:49:39.358728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 166/331] 10.222.0.26 () {58 vars in 1154 bytes} [Mon May 9 09:49:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:39.369684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8dc5c8f4-fa3b-4615-bb2c-0c293e71becf tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef46d30>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.447029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:39.450916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8dc5c8f4-fa3b-4615-bb2c-0c293e71becf tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084800 May 09 09:49:39.451491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 167/332] 10.222.0.26 () {58 vars in 1187 bytes} [Mon May 9 09:49:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:49:39.455853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2045ef0-3453-42b0-b9e8-1c5369b95572 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.153558 May 09 09:49:39.456543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 166/333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:39 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:39.462919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f8a0d0f-0051-46ef-83ae-672f73e20ebf tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] Calling method '.version_select at 0x7fa45ef40dc0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:39.550658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f8a0d0f-0051-46ef-83ae-672f73e20ebf tempest-VolumesTestJSON-1487224353 tempest-VolumesTestJSON-1487224353-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.091511 May 09 09:49:39.551234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 168/334] 10.222.0.26 () {58 vars in 1154 bytes} [Mon May 9 09:49:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:40.095650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:40.096367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:40.104023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:40.104566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:40.105528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:40.106044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:40.458814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:40.466652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-467911c9-7f7f-42ad-8572-1e61114e85f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.377388 May 09 09:49:40.467218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 167/335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:40 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:40.473307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:40.473915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:40.482565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:40.483023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:40.484148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:40.484587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:40.627149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:40.634925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dfd116c0-77e7-44e6-aa26-be90e7e34672 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.166022 May 09 09:49:40.635497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 169/336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:40 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:41.487685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:41.488711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:41.498991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:41.499722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:41.501040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:41.501771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:41.633882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:41.644695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56a3c53f-fc4f-4b24-bb63-e690b2e53fa1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.163862 May 09 09:49:41.645262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 168/337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:41 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:41.651364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:41.652006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:41.658850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:41.659302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:41.660066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:41.660691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:41.790151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:41.797925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f846ba88-59ef-4ece-9529-d7dae2bd4f5e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.150456 May 09 09:49:41.798687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 170/338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:41 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:42.662187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:42.662804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:42.668843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:42.669292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:42.670050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:42.670478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:42.802299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:42.810343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50b34114-73cf-4ae7-aca6-f8adb74d115a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.152522 May 09 09:49:42.810887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 169/339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:42 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:42.815325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:42.815941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:42.822726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:42.823210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:42.823966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:42.824391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:42.962325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:42.969836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54492591-81cc-4a50-96d8-680f6a57f424 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.158610 May 09 09:49:42.970516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 171/340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:42 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:43.828111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:43.828897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:43.834983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:43.835441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:43.836224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:43.836708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:43.987353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:43.988408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:43.989388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:43.996630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27972045-e1bd-4073-9a52-c6318a67ea00 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.172696 May 09 09:49:43.996854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:43.997378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 170/341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:43 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:43.997827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:43.998720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:43.999349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:44.135347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:44.142859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe9323fd-c30b-4351-bd94-7cfc5cfc03b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.160007 May 09 09:49:44.143514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 172/342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:43 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:45.014205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:45.014797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:45.021071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:45.021520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:45.022287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:45.022732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:45.160043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:45.160776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:45.162641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:45.168456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:45.170618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb79aab2-fd7b-4719-b5c5-111618774519 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.160579 May 09 09:49:45.171225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 171/343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:45 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:45.177401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:45.178238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:45.178676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:45.315243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:45.322674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-307a3674-c35f-42d3-8d04-9d4eb347772d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.167020 May 09 09:49:45.323246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 173/344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:45 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:46.187457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:46.188243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:46.194314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:46.194848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:46.195767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:46.196277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:46.339974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:46.340708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:46.347279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:46.347956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:46.348850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:46.349365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:46.374867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:46.384483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea362d4f-d56b-45c0-b950-934dc657058a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.200809 May 09 09:49:46.385676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 172/345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:46 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:46.488002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:46.495464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-450d8211-d71b-4092-adda-feaf1609c3f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.159410 May 09 09:49:46.496038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 174/346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:46 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:47.401868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:47.402486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:47.408585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:47.409705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:47.410608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:47.411019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:47.511536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:47.512221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:47.519824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:47.520371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:47.521420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:47.522523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:47.548696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:47.556972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-afdf2fc5-5be5-43ba-aa5b-0a376e07c9fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.158889 May 09 09:49:47.557836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 173/347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:47 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:47.673481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:47.680894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77069092-74cd-4428-8fc0-7976f7106304 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.173452 May 09 09:49:47.681463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 175/348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:47 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:48.573971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:48.574582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:48.580656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:48.581129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:48.581963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:48.582420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:48.706708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:48.707726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:48.714562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:48.715155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:48.715992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:48.716875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:48.719155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:48.726784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75f8ff7e-4ded-45d0-bdca-2f5e12fd00ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.156653 May 09 09:49:48.727361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 174/349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:48 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:48.853312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:48.865486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae404254-2c73-4092-bbef-a83e6fb54565 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.171618 May 09 09:49:48.866316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 176/350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:48 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:49.744033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:49.744655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:49.750680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:49.751119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:49.751878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:49.752321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:49.881382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:49.882553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:49.883136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:49.889188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e3475e58-6125-4669-bf4d-dd8d76dabaf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.149033 May 09 09:49:49.889545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:49.895844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 175/351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:49 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:49.896001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:49.896001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:49.896001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:50.033459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:50.045417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca80c277-ed61-43c3-b0f4-1ba1635acd4d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.166376 May 09 09:49:50.046228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 177/352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:49 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:50.910591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:50.911625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:50.925028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:50.925997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:50.926777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:50.927202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:51.064711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:51.065593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:51.072930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:51.073103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:51.073513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:51.074301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:51.074731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:51.081051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3d88d120-1157-4c98-80d1-3ee9b156015d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.177067 May 09 09:49:51.081599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 176/353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:50 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:51.203044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:51.213670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f3867de-d0de-46c2-81df-14c3c2ad6e22 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.153146 May 09 09:49:51.214410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 178/354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:51 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:49:52.102462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:52.103578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:52.113587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:52.114054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:52.114808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:52.115243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:52.230152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:52.230738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:52.237793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:52.238280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:52.239074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:52.239507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:52.253181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:52.260737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bc698f9a-747a-4a08-8504-8546cb76bdfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.165509 May 09 09:49:52.261299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 177/355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:52 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:52.372380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:52.381310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-afc12a07-8229-4310-886d-d0d497396a1a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.154715 May 09 09:49:52.382146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 179/356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:52 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:53.278156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:53.278708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:53.285135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:53.285581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:53.286347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:53.286772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:53.403518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:53.404114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:53.410324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:53.410772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:53.411538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:53.411966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:53.419312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:53.426970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9cd73d82-d0fe-4f16-88e6-9c46f6a3862c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.152809 May 09 09:49:53.427776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 178/357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:53 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:53.545572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:53.553111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f498251b-d483-4e5e-a4f7-ae8c0f1a62ba tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.153527 May 09 09:49:53.553678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 180/358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:53 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:54.443335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:54.443936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:54.449827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:54.450220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:54.450979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:54.451398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:54.574199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:54.574713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:54.580644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:54.581166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:54.581879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:54.582357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:54.588597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:54.596448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6f3f5da5-6f71-4ee7-b84e-d2402871d03c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.156962 May 09 09:49:54.597060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 179/359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:54 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:54.713288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:54.721026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c362222-070c-4e10-b7f8-ca3a71a68db0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.153579 May 09 09:49:54.721583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 181/360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:54 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:55.617600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:55.618602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:55.629088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:55.629544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:55.630323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:55.630749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:55.738133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:55.738701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:55.745444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:55.745871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:55.746640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:55.747079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:55.759613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:55.767135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3866214b-8f30-49f7-adda-f6fd60040d4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.156063 May 09 09:49:55.767715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 180/361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:55 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:55.883664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:55.891269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8d826a9-69b0-48cd-a539-85f3cc1853b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.157088 May 09 09:49:55.891835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 182/362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:55 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:56.789480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:56.790556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:56.800453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:56.801396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:56.802159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:56.802587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:56.907667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:56.908230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:56.915414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:56.915878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:56.916776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:56.917127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:56.949248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:56.957559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc4e320f-2874-43cc-a6b3-6b869c363389 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.174712 May 09 09:49:56.958156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 181/363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:56 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:57.047231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:57.055088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e4d8a8d-0d12-4cf6-8ec9-c9faa48ec4a9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.151416 May 09 09:49:57.064094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 183/364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:56 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:57.978945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:57.980041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:57.990866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:57.991589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:57.992886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:57.993626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:58.071907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:58.072369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:58.079095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:58.079538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:58.080307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:58.080760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:58.138170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:58.145694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0856072a-7f2e-416a-9190-681be6b16ff0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.173450 May 09 09:49:58.146263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 182/365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:57 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:58.224435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:58.235755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a9a6cf8d-c590-4539-8d6f-9d10db66ca93 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.167687 May 09 09:49:58.236492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 184/366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:58 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:59.162687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:59.163259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:59.171688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:59.172129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:59.172938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:59.173370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:59.255381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:49:59.256645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:49:59.264991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:59.265779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:59.266625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:49:59.267118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:49:59.332994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:59.340472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93aaa736-e75b-4565-9f78-e2c07c76ab36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.181653 May 09 09:49:59.344712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 183/367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:59 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:49:59.400757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:49:59.408553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae39dff7-ac2f-4602-aa34-94b0d297f19c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.157272 May 09 09:49:59.409125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 185/368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:49:59 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:00.359247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:00.359858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:00.367641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:00.368110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:00.368908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:00.369351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:00.424973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:00.425584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:00.432310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:00.432808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:00.433576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:00.434015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:00.508276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:00.515949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8259caed-d473-47b2-970a-85d76d6825a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.162714 May 09 09:50:00.516557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 184/369] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:00 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:00.573300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:00.580649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9aa37340-7170-404f-b866-691134dc01ad tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.159688 May 09 09:50:00.581232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 186/370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:00 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:01.533722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:01.535155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:01.542443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:01.542979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:01.543987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:01.544576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:01.600601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:01.601718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:01.609033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:01.609636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:01.611035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:01.611160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:01.682358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:01.690273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ccb15db3-bfb3-48d6-8406-97e1f7137b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.160669 May 09 09:50:01.691006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 185/371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:01 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:01.750210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:01.757763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81d3be4a-3685-4d79-bf08-0a5050b34bf9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.164148 May 09 09:50:01.758442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 187/372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:01 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:02.706802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:02.707415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:02.713578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:02.714171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:02.714941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:02.715371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:02.775224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:02.775812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:02.782631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:02.783099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:02.783864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:02.784292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:02.868504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:02.880264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a1a8257-9308-451c-bde3-1f555434833c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.177200 May 09 09:50:02.889811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 186/373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:02 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:02.938667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:02.948864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-accabb22-5b52-4fa1-81db-30403ddc2bfb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.177558 May 09 09:50:02.958425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 188/374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:02 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:02.982073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-c9b9411a-94b0-42b2-86e1-161a2ff3a30a req-3bf6d2b1-0ac9-4652-8d43-19cc94a0205e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2554f24-99b6-4ba6-91e9-9ec6289fbda0", "name": "network-vif-plugged", "status": "completed", "tag": "d72de17a-e8f0-4642-9de8-3696406e4a3f"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:02.993110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c9b9411a-94b0-42b2-86e1-161a2ff3a30a req-3bf6d2b1-0ac9-4652-8d43-19cc94a0205e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:02.993858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c9b9411a-94b0-42b2-86e1-161a2ff3a30a req-3bf6d2b1-0ac9-4652-8d43-19cc94a0205e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:03.007047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-c9b9411a-94b0-42b2-86e1-161a2ff3a30a req-3bf6d2b1-0ac9-4652-8d43-19cc94a0205e service nova] Creating event network-vif-plugged:d72de17a-e8f0-4642-9de8-3696406e4a3f for instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 on hv-cinder-84108 May 09 09:50:03.012552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-c9b9411a-94b0-42b2-86e1-161a2ff3a30a req-3bf6d2b1-0ac9-4652-8d43-19cc94a0205e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034770 May 09 09:50:03.013573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 187/375] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:03.897137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:03.897594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:03.904499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:03.904992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:03.905765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:03.906195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:03.966347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:03.966924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:03.973310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:03.973832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:03.974600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:03.975047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:04.049336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:04.066889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19b79ca7-20bf-4151-a815-1c6705da6b72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.171668 May 09 09:50:04.067518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 189/376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:03 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:04.121596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:04.128969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6e2caaf-f157-414d-872a-c0bbd162b989 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.167055 May 09 09:50:04.129540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 188/377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:03 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:05.085692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:05.086402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:05.094276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:05.094728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:05.095523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:05.095982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:05.145760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:05.146367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:05.152566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:05.153060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:05.153840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:05.154449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:05.229679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:05.237419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d75fdbf-c93e-42ea-ae00-0d0c5c97cf59 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.156829 May 09 09:50:05.237991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 190/378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:05 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:05.286989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:05.294973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a9feb4d-d4e5-45e5-a5bc-acfe11315eb2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.153265 May 09 09:50:05.295532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 189/379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:05 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:06.253508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:06.254094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:06.260619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.261095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.261855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.262295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.311633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:06.312257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:06.318831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.319289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.320062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.320490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.401133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:06.409335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2d487289-e081-42d3-8794-c18f21c344ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1502 microversion: 2.1 time: 0.159729 May 09 09:50:06.413801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 191/380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:06 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:06.425686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf817fb0-188f-4a85-afc3-5553eaa754ca"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:06.426825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:06.433039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.433474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.434236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.434667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.457436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Cannot 'attach_volume' instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 while it is in vm_state rescued May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/os-volume_attachments HTTP/1.1 May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 74 May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:50:06.459156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {"volumeAttachment": {"volumeId": "cf817fb0-188f-4a85-afc3-5553eaa754ca"}} May 09 09:50:06.460616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Cannot 'attach_volume' instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 while it is in vm_state rescued May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': '584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1', 'body': {'volumeAttachment': {'volumeId': 'cf817fb0-188f-4a85-afc3-5553eaa754ca'}}} May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:50:06.461527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 while it is in vm_state rescued May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:50:06.462674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:50:06.463943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:50:06.463943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:50:06.463943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 while it is in vm_state rescued May 09 09:50:06.463943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:50:06.463943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 409 to user: Cannot 'attach_volume' instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 while it is in vm_state rescued {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:50:06.463943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c8879ac1-dea0-41c6-a597-102bb1c22157 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038956 May 09 09:50:06.465326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 192/381] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:50:06 2022] POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 09 09:50:06.469656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:06.470182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:06.476993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.477522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.478432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.478937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.506003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:06.515804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5c566f43-fcfe-4b6c-b75f-34e5048921ac tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.207907 May 09 09:50:06.521824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 190/382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:06.552695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6710ad7a-079d-4449-b256-35b1aa844c13 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/action" status: 202 len: 0 microversion: 2.1 time: 0.086632 May 09 09:50:06.553388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 193/383] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:50:06 2022] POST /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:50:06.561617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:06.562213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:06.568148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.568595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.569402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:06.569842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:06.706684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:06.718891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02068c25-f014-4187-84f0-d69edae89787 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1510 microversion: 2.1 time: 0.161077 May 09 09:50:06.719614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 191/384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:06 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:07.537621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:07.538585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:07.546761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:07.547317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:07.548264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:07.548844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:07.690987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:07.699859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1d962c2-11a8-4111-b92b-5fdae4ebf545 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1265 microversion: 2.1 time: 0.169839 May 09 09:50:07.700504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 194/385] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:07 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:07.737768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:07.738533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:07.744702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:07.745154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:07.745958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:07.746421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:07.876985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:07.884629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21e54d4e-5495-44cd-a211-2809df28cf11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1510 microversion: 2.1 time: 0.150792 May 09 09:50:07.885238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 192/386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:07 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:08.721625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:08.722491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:08.729349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:08.729881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:08.730650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:08.731154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:08.875058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:08.886055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc46f9f6-eff6-4df5-8180-17e6de57c0f4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1452 microversion: 2.1 time: 0.168355 May 09 09:50:08.886610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 195/387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:08 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:08.904800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:08.906077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:08.907442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:08.908000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:08.914347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:08.915032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:08.915801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:08.916230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:08.921220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:08.921914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:08.922832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:08.923365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:09.095517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:09.096986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:09.103609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d73c3a9c-1348-4247-ac5c-f7bc89081f90 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1452 microversion: 2.1 time: 0.201757 May 09 09:50:09.104189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 196/388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:08 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:09.105731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-586d5c60-ddc5-4373-9317-8c36782aed53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1510 microversion: 2.1 time: 0.205507 May 09 09:50:09.106297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 193/389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:08 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:10.128620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:10.129274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:10.140296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:10.141332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:10.142683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:10.143343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:10.306884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:10.314380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d9f53db-0df8-436f-b8f7-edd2148f516a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1510 microversion: 2.1 time: 0.194630 May 09 09:50:10.315138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 197/390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:10 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:11.331563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:11.340212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:11.351121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:11.351569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:11.352584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:11.353517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:11.395022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-cdc64cd5-7940-4f32-8607-6ce5ea992965 req-9df3198f-e7c3-4104-b1fc-e5de32107ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2554f24-99b6-4ba6-91e9-9ec6289fbda0", "tag": "d72de17a-e8f0-4642-9de8-3696406e4a3f"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:11.412903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cdc64cd5-7940-4f32-8607-6ce5ea992965 req-9df3198f-e7c3-4104-b1fc-e5de32107ac4 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:11.413374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cdc64cd5-7940-4f32-8607-6ce5ea992965 req-9df3198f-e7c3-4104-b1fc-e5de32107ac4 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:11.425967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-cdc64cd5-7940-4f32-8607-6ce5ea992965 req-9df3198f-e7c3-4104-b1fc-e5de32107ac4 service nova] Creating event network-changed:d72de17a-e8f0-4642-9de8-3696406e4a3f for instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 on hv-cinder-84108 May 09 09:50:11.433383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-cdc64cd5-7940-4f32-8607-6ce5ea992965 req-9df3198f-e7c3-4104-b1fc-e5de32107ac4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040586 May 09 09:50:11.434169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 198/391] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:50:11.551013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:11.579040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-88122d28-a6f6-43e5-bb3f-23a57f862ea9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1510 microversion: 2.1 time: 0.249757 May 09 09:50:11.580628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 194/392] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:11 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:12.600237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:12.602468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:12.609447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:12.609985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:12.611055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:12.611655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:12.764397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:12.772512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b8149a66-0b55-4fce-949b-47b37bc6f81a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1516 microversion: 2.1 time: 0.177581 May 09 09:50:12.773106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 199/393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:12 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:14.183979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa3562a2-f400-4db9-a0d0-fe30ede7bbf9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'create', calling method: .version_select at 0x7fa46417a670>, body: {"keypair": {"name": "tempest-keypair-1643973997"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:14.232131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-fa3562a2-f400-4db9-a0d0-fe30ede7bbf9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:14.244388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-fa3562a2-f400-4db9-a0d0-fe30ede7bbf9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for user e58c14dca7da4e6495f7e08f2bb127e2 and project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:14.365645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-fa3562a2-f400-4db9-a0d0-fe30ede7bbf9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:14.373324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-fa3562a2-f400-4db9-a0d0-fe30ede7bbf9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for user e58c14dca7da4e6495f7e08f2bb127e2 and project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:14.404436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa3562a2-f400-4db9-a0d0-fe30ede7bbf9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.227297 May 09 09:50:14.405767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 195/394] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 09:50:14 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:16.989026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1664771189", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5db3e70-fbca-49f7-aa77-27bb8754df68"}], "security_groups": [{"name": "tempest-securitygroup--1641382390"}], "key_name": "tempest-keypair-1643973997", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:17.162965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] validate_networks() for [('a5db3e70-fbca-49f7-aa77-27bb8754df68', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:50:17.876016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:50:17.876488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:50:17.877082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:50:17.877501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:50:17.878274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:50:17.895622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:17.899153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:17.903796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:17.903796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:17.933274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:17.943972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Getting quotas for user e58c14dca7da4e6495f7e08f2bb127e2 and project 0511fef4fd9f4bd09a3b1867e8556a06. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:17.966865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:50:17.969981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:50:18.112883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8c04ba88-30d3-4205-988e-2941529ba15f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.126808 May 09 09:50:18.116315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 200/395] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:50:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:50:18.126684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-29886d35-b817-481c-9de7-8c58598176d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:18.128176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-29886d35-b817-481c-9de7-8c58598176d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:18.208103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-29886d35-b817-481c-9de7-8c58598176d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:18.216729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-29886d35-b817-481c-9de7-8c58598176d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1246 microversion: 2.1 time: 0.094208 May 09 09:50:18.224707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 196/396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:19.234659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:19.235279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:19.243841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:19.244448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:19.245299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:19.246019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:19.678657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:19.687354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29bf05b0-2c9c-495e-8f4c-53c8e780d12a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1298 microversion: 2.1 time: 0.457130 May 09 09:50:19.691289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 201/397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1298 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:20.355587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2110315204", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "networks": [{"uuid": "a38514dd-d2b0-4658-99b8-ef1afc68db93"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:20.413713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] validate_networks() for [('a38514dd-d2b0-4658-99b8-ef1afc68db93', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:50:20.710716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:20.712636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:20.724027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:20.724915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:20.726077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:20.726830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:20.840758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:20.851455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44aa2e9d-2b61-4e3a-bb64-6a334f653775 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1304 microversion: 2.1 time: 0.146821 May 09 09:50:20.863942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 202/398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:21.706084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:50:21.707944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:50:21.708888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:50:21.709550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:50:21.710257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:50:21.731304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:21.732851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:21.733952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:21.735724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:21.769888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Getting quotas for project 084ec4bab56b4c1d823158e34705bbf0. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:21.780950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Getting quotas for user 17a673de26884004bc852ef76b18aa06 and project 084ec4bab56b4c1d823158e34705bbf0. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:21.814749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:50:21.818686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:50:21.875978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:21.878300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:21.883005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [61b7ad81-849f-4726-a5cd-a4637562d48b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 09:50:21.890515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:21.891246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:21.897617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:21.898767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:22.094600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:22.102632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-062fc51b-fe8f-4813-b3ef-e2295b346be4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.235688 May 09 09:50:22.113070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 203/399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:22.893168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [61b7ad81-849f-4726-a5cd-a4637562d48b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37806. May 09 09:50:22.904966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4130a6f7-d772-4695-929f-4c60268198ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.551450 May 09 09:50:22.907868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 197/400] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:50:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:50:22.917568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f48af2d9-eba7-4847-9380-33c60c4d14d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:22.918198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f48af2d9-eba7-4847-9380-33c60c4d14d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:23.006850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f48af2d9-eba7-4847-9380-33c60c4d14d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:23.016870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f48af2d9-eba7-4847-9380-33c60c4d14d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1219 microversion: 2.1 time: 0.103122 May 09 09:50:23.018668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 204/401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:22 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:23.129263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:23.131765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:23.153206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:23.153717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:23.155117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:23.156028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:23.430209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-b6c3cbc7-3f65-4abb-b6ea-134bff3c68fc req-81dded36-d144-4b9d-a820-a27944a21832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:23.446937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b6c3cbc7-3f65-4abb-b6ea-134bff3c68fc req-81dded36-d144-4b9d-a820-a27944a21832 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:23.447579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b6c3cbc7-3f65-4abb-b6ea-134bff3c68fc req-81dded36-d144-4b9d-a820-a27944a21832 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:23.481642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-b6c3cbc7-3f65-4abb-b6ea-134bff3c68fc req-81dded36-d144-4b9d-a820-a27944a21832 service nova] Creating event network-changed:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 09:50:23.493662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-b6c3cbc7-3f65-4abb-b6ea-134bff3c68fc req-81dded36-d144-4b9d-a820-a27944a21832 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066822 May 09 09:50:23.496556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 205/402] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:50:23.773719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:23.784693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0cab1646-d555-4e93-a656-4534363f4a8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.667140 May 09 09:50:23.800933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 198/403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:24.037843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:24.039497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:24.071932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:24.078644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:24.079717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:24.080655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:24.252905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:24.263060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3091b7c6-5533-4add-816c-63d6e7ee7445 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1215 microversion: 2.1 time: 0.232056 May 09 09:50:24.274865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 206/404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:24 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:24.811082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:24.812406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:24.819029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:24.819737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:24.820766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:24.821346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:25.038434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:25.046885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9544d303-3a22-462c-9a40-64ed2ca8e5e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.244620 May 09 09:50:25.057009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 199/405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:25.281346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:25.282493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:25.289570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:25.290098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:25.291128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:25.291626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:25.387470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:25.395259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-efaa0d95-6a44-47ca-8c45-024d2a03056f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1279 microversion: 2.1 time: 0.118761 May 09 09:50:25.405304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 207/406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:25 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:26.064981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:26.066441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:26.072972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:26.073650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:26.074788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:26.075430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:26.236165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:26.249537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8abc9b14-6cef-4176-b5a5-877580ff5cce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.189700 May 09 09:50:26.259938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 200/407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:26.412461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:26.413619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:26.420413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:26.420935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:26.421705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:26.422131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:26.487177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:26.494592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95469113-481c-4a3c-b4ae-254bdc2b4e29 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1279 microversion: 2.1 time: 0.086332 May 09 09:50:26.495180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 208/408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:26 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:27.268620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:27.270094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:27.276983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:27.277632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:27.278612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:27.279073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:27.431789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:27.439955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fcdccb3d-6a9a-4181-ab56-65c9dbc189f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.176796 May 09 09:50:27.449078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 201/409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:27.511357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:27.511980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:27.519029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:27.519712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:27.520985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:27.521884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:27.631572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:27.644733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4c45e53-51cf-4ef8-9079-879fc9e26c57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1279 microversion: 2.1 time: 0.136773 May 09 09:50:27.651682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 209/410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:27 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1279 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:28.460089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:28.461552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:28.468380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:28.469040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:28.470693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:28.471288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:28.623350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:28.632637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c51dbc4d-92dd-4839-ba90-125705743bca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.177217 May 09 09:50:28.633779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 202/411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:28.661855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:28.662628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:28.669666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:28.670412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:28.671387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:28.671973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:28.738830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:28.748220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70518b8e-63d8-45ad-9367-a386d48f8759 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1279 microversion: 2.1 time: 0.090429 May 09 09:50:28.749376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 210/412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:28 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:29.650124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:29.651467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:29.662602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:29.663059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:29.663858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:29.664283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:29.774786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:29.776023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:29.783850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:29.784808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:29.785836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:29.787373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:29.877738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:29.899828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-439e586d-4a07-4430-94a5-f0cbfe4a8094 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.254222 May 09 09:50:29.902866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 203/413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:29.962033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:29.977515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1bcbb294-78e0-400d-b5b1-18200c5a219a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1279 microversion: 2.1 time: 0.212121 May 09 09:50:29.980022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 211/414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:29 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:30.919216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:30.920546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:30.927163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:30.927844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:30.929176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:30.929644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:31.004127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:31.008205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:31.033166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:31.033685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:31.034552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:31.034983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:31.103451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:31.116256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:31.116455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c5826af-5d72-4675-bc39-e51957dff94f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.200886 May 09 09:50:31.116455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 204/415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:31.119503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-48eb0cab-fa7f-4609-a51c-052225456e5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1279 microversion: 2.1 time: 0.126434 May 09 09:50:31.120083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 212/416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:30 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:32.139442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:32.140119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:32.146078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:32.147896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:32.149155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:32.149597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:32.153482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:32.153933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:32.169603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:32.173119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:32.179361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:32.179833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:32.326688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:32.340517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f9e8f73-c90b-47b7-9205-1a7c4111488e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1277 microversion: 2.1 time: 0.207566 May 09 09:50:32.352772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 213/417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:32 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:32.492558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:32.505918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37c54028-a5ff-4481-a94b-ee68c16da01a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.378172 May 09 09:50:32.506825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 205/418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:33.359583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:33.360914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:33.368042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:33.368489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:33.369462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:33.370061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:33.522841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:33.529576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:33.548287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:33.550111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:33.551758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:33.552400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:33.559976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:33.568707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7fafc40a-35b5-4805-bcb9-4eee2b0cc5e1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.214236 May 09 09:50:33.569668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 214/419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:33 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:33.752547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:33.764000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1fef2c4-7df0-4d0d-a8ef-b564abd983cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.245069 May 09 09:50:33.773809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 206/420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:33.802491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-7bd3e27a-ba24-4217-9c1b-7e7d00628706 req-b8ba8a45-85a6-4312-bfe0-3503e9920e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2621882-622c-44e5-8ea9-9b702f9079df", "tag": "48d28e6a-7797-49da-a9c8-8d48d4516fd4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:33.813531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-7bd3e27a-ba24-4217-9c1b-7e7d00628706 req-b8ba8a45-85a6-4312-bfe0-3503e9920e94 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:33.813967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-7bd3e27a-ba24-4217-9c1b-7e7d00628706 req-b8ba8a45-85a6-4312-bfe0-3503e9920e94 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:33.838079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-7bd3e27a-ba24-4217-9c1b-7e7d00628706 req-b8ba8a45-85a6-4312-bfe0-3503e9920e94 service nova] Creating event network-changed:48d28e6a-7797-49da-a9c8-8d48d4516fd4 for instance c2621882-622c-44e5-8ea9-9b702f9079df on hv-cinder-84108 May 09 09:50:33.851496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-7bd3e27a-ba24-4217-9c1b-7e7d00628706 req-b8ba8a45-85a6-4312-bfe0-3503e9920e94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054151 May 09 09:50:33.852442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 215/421] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:34.418555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-d581c383-69c4-4156-97d0-abc170a13767 req-8b0bb88b-0fff-4ddb-9320-2265ef670b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "name": "network-vif-plugged", "status": "completed", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:34.429745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-d581c383-69c4-4156-97d0-abc170a13767 req-8b0bb88b-0fff-4ddb-9320-2265ef670b5d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:34.431075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-d581c383-69c4-4156-97d0-abc170a13767 req-8b0bb88b-0fff-4ddb-9320-2265ef670b5d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:34.455583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-d581c383-69c4-4156-97d0-abc170a13767 req-8b0bb88b-0fff-4ddb-9320-2265ef670b5d service nova] Creating event network-vif-plugged:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 09:50:34.463317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-d581c383-69c4-4156-97d0-abc170a13767 req-8b0bb88b-0fff-4ddb-9320-2265ef670b5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050179 May 09 09:50:34.464434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 207/422] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:34.585752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:34.586890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:34.594044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:34.594474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:34.595248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:34.595677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:34.772591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:34.782284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:34.784715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:34.798257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-944b9feb-2b05-4e22-a7be-ffa2f534ab69 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.217132 May 09 09:50:34.799817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 216/423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:34 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:34.812597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:34.813784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:34.814819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:34.815501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:34.965941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:34.974398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d91df220-b30a-4a24-988f-8f506b608376 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.196945 May 09 09:50:34.983808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 208/424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:35.817830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:35.819295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:35.827293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:35.827881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:35.828785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:35.829314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:35.959666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:35.967495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-34d4bc08-4171-4184-91e7-c38975cec681 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.153615 May 09 09:50:35.968154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 217/425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:35 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:35.992759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:35.993513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:36.000694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:36.001260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:36.002457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:36.002457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:36.107588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba7c260c-0c31-4424-99b8-1cfb393546f7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Action: 'create', calling method: .version_select at 0x7fa45ef1e040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-713787344"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:36.122116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-ba7c260c-0c31-4424-99b8-1cfb393546f7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Getting quotas for project b1c46939bf6f40f19dac93cf5d494ab1. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:36.126351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-ba7c260c-0c31-4424-99b8-1cfb393546f7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Getting quotas for user cba3e3a904ca41b78e518699f88e315e and project b1c46939bf6f40f19dac93cf5d494ab1. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:36.142046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:36.150971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2baf851d-74bb-4844-9ac4-ebb55da2ebb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.162654 May 09 09:50:36.157817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 209/426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:36.246596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-ba7c260c-0c31-4424-99b8-1cfb393546f7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Getting quotas for project b1c46939bf6f40f19dac93cf5d494ab1. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:36.250526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-ba7c260c-0c31-4424-99b8-1cfb393546f7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Getting quotas for user cba3e3a904ca41b78e518699f88e315e and project b1c46939bf6f40f19dac93cf5d494ab1. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:36.263865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba7c260c-0c31-4424-99b8-1cfb393546f7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.160541 May 09 09:50:36.264700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 218/427] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 09:50:36 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:36.363097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1776086421", "imageRef": "f1fca720-832e-4c9f-b71c-5dcb04a93143", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-713787344", "networks": [{"uuid": "1b9128e5-5df8-436d-aa20-a0631f0e90b2"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:36.414141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] validate_networks() for [('1b9128e5-5df8-436d-aa20-a0631f0e90b2', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:50:36.791474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:50:36.791907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:50:36.792566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:50:36.792985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:50:36.793438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:50:36.803796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:36.804264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:36.805089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:36.805529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:36.825764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Getting quotas for project b1c46939bf6f40f19dac93cf5d494ab1. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:50:36.829584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Getting quotas for user cba3e3a904ca41b78e518699f88e315e and project b1c46939bf6f40f19dac93cf5d494ab1. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:50:36.840116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:50:36.842449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f1fca720-832e-4c9f-b71c-5dcb04a93143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:50:36.892908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bf719635-5ca5-48d6-bbb2-038812992a54 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533805 May 09 09:50:36.893446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 210/428] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:50:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:50:36.903966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0fbd8846-de56-44c2-9825-814ab2bd97d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:36.905183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0fbd8846-de56-44c2-9825-814ab2bd97d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:36.960962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0fbd8846-de56-44c2-9825-814ab2bd97d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:36.970221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0fbd8846-de56-44c2-9825-814ab2bd97d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1258 microversion: 2.1 time: 0.070566 May 09 09:50:36.970818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 219/429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:36 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:36.986882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:36.987497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:36.994676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:36.995274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:36.995952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:36.996446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:37.141987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:37.149700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0ed42a4-59d9-4d75-91cd-8b8b487d8731 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.167027 May 09 09:50:37.150398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 211/430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:36 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:37.167744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:37.168729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:37.176115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:37.176723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:37.177544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:37.178178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:37.308286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:37.315669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c3d6834c-5751-4a00-94f2-a5fa29a15ddb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.151930 May 09 09:50:37.316233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 220/431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:37.990624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:37.991342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:37.999112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:37.999812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:38.000572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:38.001099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:38.069600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:38.079733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57c523d4-e546-463c-88bc-f76cc93bc89c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1310 microversion: 2.1 time: 0.094712 May 09 09:50:38.080296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 212/432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:38.167448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:38.168719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:38.175651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:38.176103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:38.176923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:38.177362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:38.315085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:38.325008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1174c2f1-edcd-46d1-a773-5a2064254843 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.161355 May 09 09:50:38.326512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 221/433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:38 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:38.333456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:38.334329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:38.342393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:38.343039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:38.344042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:38.344626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:38.529358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:38.537275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e4d22f0a-ad0d-40ad-b416-0629605292a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.207665 May 09 09:50:38.537885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 213/434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:39.098325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:39.098951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:39.105423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:39.105884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:39.107054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:39.107494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:39.170728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:39.179094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc8a5afa-75a7-4575-b587-4229af07c0c4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1310 microversion: 2.1 time: 0.084905 May 09 09:50:39.179700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 222/435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:39.342984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:39.343574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:39.351853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:39.352547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:39.353826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:39.354476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:39.485604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:39.493293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73b837f4-0c9b-4a10-baa0-138b29de9380 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.154285 May 09 09:50:39.493858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 214/436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:39 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:39.554439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:39.555072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:39.561607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:39.562052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:39.562827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:39.563249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:39.699919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:39.711629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ab962743-d768-4ab9-a4ad-b40323b74878 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1372 microversion: 2.1 time: 0.160843 May 09 09:50:39.712263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 223/437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:40.203810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:40.204917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:40.212490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.212967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.213731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.214163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.275197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:40.282908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0aaeb417-fb77-4e81-b1db-fddc280a9c55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1318 microversion: 2.1 time: 0.085621 May 09 09:50:40.283707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 215/438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1318 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:40.427224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-cfb0f5d7-39bf-4ca3-889b-09b3725b69e7 req-16a26ffd-4b0b-4109-9c50-b2101c6be276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2621882-622c-44e5-8ea9-9b702f9079df", "name": "network-vif-plugged", "status": "completed", "tag": "48d28e6a-7797-49da-a9c8-8d48d4516fd4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:40.435971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cfb0f5d7-39bf-4ca3-889b-09b3725b69e7 req-16a26ffd-4b0b-4109-9c50-b2101c6be276 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.436456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cfb0f5d7-39bf-4ca3-889b-09b3725b69e7 req-16a26ffd-4b0b-4109-9c50-b2101c6be276 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.449558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-cfb0f5d7-39bf-4ca3-889b-09b3725b69e7 req-16a26ffd-4b0b-4109-9c50-b2101c6be276 service nova] Creating event network-vif-plugged:48d28e6a-7797-49da-a9c8-8d48d4516fd4 for instance c2621882-622c-44e5-8ea9-9b702f9079df on hv-cinder-84108 May 09 09:50:40.454508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-cfb0f5d7-39bf-4ca3-889b-09b3725b69e7 req-16a26ffd-4b0b-4109-9c50-b2101c6be276 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031011 May 09 09:50:40.455042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 224/439] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:40.510468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:40.511079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:40.517537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.518011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.518814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.519244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.650460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:40.658059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2704e488-3e6d-4ad6-a32d-de09f631b80c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.151632 May 09 09:50:40.658697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 216/440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:40 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:40.733542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:40.734593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:40.742040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.742813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.743595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.744033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.899999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:40.909906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c09e5c1-05b1-491d-ab38-ca8512ef6960 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1566 microversion: 2.1 time: 0.181011 May 09 09:50:40.910509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 225/441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:40.927880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:40.928543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:40.935126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.935867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:40.936644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:40.937144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:41.055143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-871a4b4e-9768-441e-923b-6adc338601aa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131263 May 09 09:50:41.056076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 217/442] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 09:50:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:41.301751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:41.302368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:41.311194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:41.313183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:41.316890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:41.317502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:41.675631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:41.680349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:41.687303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:41.688024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:41.689015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:41.689736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:41.899137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:41.910797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78c13a28-6e4c-4d72-9ca7-29a264ced01c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.238268 May 09 09:50:41.939916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 218/443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:41 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:42.071429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:42.079932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f5d3334-ae4c-4bb3-b167-8b03ba9ca721 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.782517 May 09 09:50:42.082414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 226/444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:42.592872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-eee81959-4c8d-427d-adfd-18ac3dcb2635 req-a3db6b3d-add1-4966-a9c9-92cb23c0ead7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:42.601677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-eee81959-4c8d-427d-adfd-18ac3dcb2635 req-a3db6b3d-add1-4966-a9c9-92cb23c0ead7 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:42.602093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-eee81959-4c8d-427d-adfd-18ac3dcb2635 req-a3db6b3d-add1-4966-a9c9-92cb23c0ead7 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:42.614021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-eee81959-4c8d-427d-adfd-18ac3dcb2635 req-a3db6b3d-add1-4966-a9c9-92cb23c0ead7 service nova] Creating event network-changed:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 09:50:42.619829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-eee81959-4c8d-427d-adfd-18ac3dcb2635 req-a3db6b3d-add1-4966-a9c9-92cb23c0ead7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030760 May 09 09:50:42.620555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 219/445] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:42.945440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:42.946141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:42.952559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:42.953241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:42.954114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:42.954552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:43.099827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:43.101182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:43.102572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:43.108011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:43.108725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:43.109667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:43.110245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:43.118763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-104b5d48-8947-469e-a7a4-e0e2f060c18e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.177281 May 09 09:50:43.119873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 227/446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:42 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:43.268201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:43.276126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8164622-b7ee-495b-8d75-89851b3e7373 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.180566 May 09 09:50:43.276841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 220/447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:43 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:44.139900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:44.140513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:44.150203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:44.150822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:44.151922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:44.152398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:44.293250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:44.294589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:44.301095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:44.301905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:44.303226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:44.303663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:44.305078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:44.313241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9a6dbea2-3672-418c-abbe-037520329ce6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.180140 May 09 09:50:44.313860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 228/448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:44 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:44.454124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:44.461646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20a60c56-d4df-4ec1-9db6-da0a850f8764 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.172392 May 09 09:50:44.462214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 221/449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:45.334449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:45.336507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:45.343716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:45.344476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:45.345490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:45.346105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:45.480309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:45.481093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:45.482042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:45.489659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:45.490118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:45.490837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b2a1068f-aea9-4dd0-bc54-ebad56d31185 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.163611 May 09 09:50:45.490983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:45.491333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:45.492912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 229/450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:45 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:45.654483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:45.662163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7266ce69-5f71-4bef-a793-80edfc21b0bc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.186466 May 09 09:50:45.662791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 222/451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:46.510310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:46.510945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:46.517442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:46.517895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:46.518644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:46.519091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:46.658383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:46.666876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad49759e-b362-4cd2-a59d-edf6b047b28b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.160735 May 09 09:50:46.667484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 230/452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:46 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:46.679486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:46.680823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:46.687200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:46.687644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:46.688428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:46.688877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:46.829832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:46.837370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0295aa9-3997-4345-ba01-bd72e14529b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.161897 May 09 09:50:46.838430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 223/453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:47.683952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:47.684638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:47.691532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:47.691978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:47.692787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:47.693217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:47.843870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:47.851917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dbc87577-cfd1-45c8-a52f-e461edc692e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.172069 May 09 09:50:47.856175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:47.857928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:47.860251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 231/454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:47 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:47.865311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:47.865763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:47.866552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:47.866985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:48.027958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:48.037245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af596317-0215-47ab-a663-7f2c85b2051f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.185684 May 09 09:50:48.037757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 224/455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:47 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:48.869841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:48.870544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:48.878389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:48.878862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:48.879858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:48.880390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:49.043646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:49.052744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91a7dfe8-71c7-45e6-af4d-689ec13b8384 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.186854 May 09 09:50:49.053344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 232/456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:48 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:49.055268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:49.055906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:49.062203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:49.062650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:49.063434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:49.063865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:49.208952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:49.218626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78805488-68af-4796-9134-ee8d3824f10b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.167045 May 09 09:50:49.219552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 225/457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:50.070503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:50.071268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:50.077750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:50.078192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:50.078948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:50.079375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:50.210713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:50.218246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b88537a-5374-48aa-b3fb-189f6c09e109 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.151750 May 09 09:50:50.218828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 233/458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:50 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:50.235620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:50.236211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:50.242356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:50.242793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:50.243566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:50.244031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:50.377437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:50.385754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a31b8bd-01b9-43c8-866c-fb720aafd2a1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.154276 May 09 09:50:50.386456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 226/459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:50 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:51.235606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:51.236290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:51.243276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:51.243822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:51.244612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:51.245082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:51.385180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:51.392517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7690ce0f-59f2-4141-bcab-a02a8d4a22c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.161740 May 09 09:50:51.393118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 234/460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:51 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:51.403613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:51.404215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:51.410157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:51.410596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:51.411358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:51.411787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:51.541923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:51.551303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fdf2fe8a-e7ac-4b01-a27c-c95892ef8223 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.151597 May 09 09:50:51.552128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 227/461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:52.410062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:52.410915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:52.417544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:52.418037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:52.418820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:52.419249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:52.569230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:52.570558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:52.576694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:52.577386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:52.578102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:52.579335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:52.580643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:52.594508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-47c12eff-6c9f-420a-8e3d-eb035048e931 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.188325 May 09 09:50:52.595106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 235/462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:52 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:52.723150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:52.730730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26a82be6-4fe6-4707-a33c-2ae8233b7b03 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.165925 May 09 09:50:52.731643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 228/463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:52 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:53.613776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:53.614388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:53.621216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:53.621661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:53.622433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:53.622873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:53.749218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:53.751249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:53.751873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:53.757494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-24262004-7fa1-4928-9a26-9789fdd24d0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.147901 May 09 09:50:53.758077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 236/464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:53 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:53.758258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:53.758672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:53.759493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:53.759917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:53.889659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:53.897525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9f011c19-1425-462c-99ae-599244c37acd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.150242 May 09 09:50:53.898097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 229/465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:54.775035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:54.775612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:54.782602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:54.783051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:54.783831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:54.784260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:54.913974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:54.914556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:54.915173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:54.921313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:54.921516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5452f488-5412-4bd4-807f-77fdce4880a2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.150595 May 09 09:50:54.921766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:54.922092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 237/466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:54 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:54.922543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:54.922976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:55.049632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:55.057404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34f22b57-ebf6-4da5-b28a-bd7aa0f85101 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.146692 May 09 09:50:55.061008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 230/467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:55.938987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:55.939585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:55.946396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:55.946870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:55.947685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:55.948117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:56.079034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:56.079667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:56.081005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:56.086423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:56.087084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:56.087982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:56.088340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-477008fc-c452-455a-84fb-d40d49dcde67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.153351 May 09 09:50:56.088468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:56.089279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 238/468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:55 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:56.221560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:56.229091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c5be2bb-7151-42bd-83bb-e8d08b336542 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.155344 May 09 09:50:56.229677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 231/469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:57.106943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:57.107550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:57.114102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:57.114546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:57.115317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:57.115746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:57.253465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:57.254745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:57.267856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:57.268327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:57.274173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:57.275051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:57.300054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:57.310581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4605b696-e383-4c50-a17c-757285dd110a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1319 microversion: 2.1 time: 0.207961 May 09 09:50:57.319827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 239/470] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:57 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:50:57.702642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:57.710149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5a5b2811-949e-4ea2-af23-76810568209d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.467213 May 09 09:50:57.710726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 232/471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:57 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:57.750828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-9ed9023d-9f45-4558-a670-68b02d19f5a6 req-0375f4b5-5b9a-4ae3-a4c2-3d25d9827bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:50:57.760275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9ed9023d-9f45-4558-a670-68b02d19f5a6 req-0375f4b5-5b9a-4ae3-a4c2-3d25d9827bb8 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:57.761002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9ed9023d-9f45-4558-a670-68b02d19f5a6 req-0375f4b5-5b9a-4ae3-a4c2-3d25d9827bb8 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:57.783087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-9ed9023d-9f45-4558-a670-68b02d19f5a6 req-0375f4b5-5b9a-4ae3-a4c2-3d25d9827bb8 service nova] Creating event network-changed:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 09:50:57.788336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-9ed9023d-9f45-4558-a670-68b02d19f5a6 req-0375f4b5-5b9a-4ae3-a4c2-3d25d9827bb8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041243 May 09 09:50:57.788992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 240/472] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:50:58.327926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:58.328557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:58.335211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:58.335659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:58.336445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:58.336921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:58.571245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:58.579271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fdc72706-44ad-4657-b365-72505b413743 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1508 microversion: 2.1 time: 0.255355 May 09 09:50:58.579856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 233/473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:58 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:58.728108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:58.728824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:58.735866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:58.736323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:58.737144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:58.737610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:58.886015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:50:58.893637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-35f94c3b-c321-4cb6-a9d5-52faacefc4b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.170198 May 09 09:50:58.894227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 241/474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:58 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:50:59.912444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:50:59.913456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:50:59.921053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:59.921489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:50:59.922268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:50:59.922729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:00.060810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:00.068842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-11bc94cd-33cd-48d1-ba44-01e82d123816 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.161428 May 09 09:51:00.069413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 234/475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:50:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:51:01.089441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:01.090030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:01.096923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:01.097386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:01.098163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:01.098592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:01.244973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:01.253112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bbd54aee-be04-42b8-8e19-d84a536874bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.168871 May 09 09:51:01.253685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 242/476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:02.269857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:02.270514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:02.277236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:02.277705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:02.278492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:02.278924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:02.425900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:02.438316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a052fb9-aa88-4dff-b76d-b951b692f118 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.172312 May 09 09:51:02.438903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 235/477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:03.455890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:03.456471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:03.463330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:03.463773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:03.464572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:03.465036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:03.596190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:03.604613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-50b3ebfa-15d8-4ffb-904b-1e4515bccc49 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.152722 May 09 09:51:03.605229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 243/478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:04.623136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:04.623743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:04.630325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:04.630762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:04.631532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:04.631966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:04.771457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:04.779390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d5cb26f8-9cbf-4b6f-bd48-92e7eaa7b083 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.160256 May 09 09:51:04.780149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 236/479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:04 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:04.794736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-d9421476-30f0-409f-b3ba-624effac4c84 req-4af05206-7916-4945-9b83-14fb764f777f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "name": "network-vif-plugged", "status": "completed", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:04.803536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d9421476-30f0-409f-b3ba-624effac4c84 req-4af05206-7916-4945-9b83-14fb764f777f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:04.803976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d9421476-30f0-409f-b3ba-624effac4c84 req-4af05206-7916-4945-9b83-14fb764f777f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:04.819505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-d9421476-30f0-409f-b3ba-624effac4c84 req-4af05206-7916-4945-9b83-14fb764f777f service nova] Creating event network-vif-plugged:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 09:51:04.825269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-d9421476-30f0-409f-b3ba-624effac4c84 req-4af05206-7916-4945-9b83-14fb764f777f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034891 May 09 09:51:04.825871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 244/480] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:05.804206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:05.804855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:05.811967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:05.812417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:05.813372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:05.813806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:05.918892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:05.919516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:05.926282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:05.926723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:05.927489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:05.927938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:05.948966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:05.952244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c647fe0-8955-420f-9268-e7765bd7b452 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/ips" status: 200 len: 153 microversion: 2.20 time: 0.038620 May 09 09:51:05.952848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 245/481] 10.222.0.26 () {60 vars in 1288 bytes} [Mon May 9 09:51:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:51:05.956575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cac17914-115f-4a4b-bc98-fa5929da4320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.159230 May 09 09:51:05.957179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 237/482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:05 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:06.975062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:06.975668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:06.983951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:06.984631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:06.985942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:06.986704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:07.127377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:07.135856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae4a3748-3e0a-4cef-bde1-12c56d02014c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1358 microversion: 2.1 time: 0.165521 May 09 09:51:07.136582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 246/483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:08.156783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:08.157756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:08.166538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.166980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.167754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.168176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.306396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:08.314771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a4c8860f-c064-4a87-952d-2f57a9431349 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1547 microversion: 2.1 time: 0.164462 May 09 09:51:08.315359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 238/484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:08.331461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:08.331994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:08.338486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.338935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.339703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.340144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.483102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:08.490668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea20cfc1-60ca-49c0-9271-6c78239dd476 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1547 microversion: 2.1 time: 0.163029 May 09 09:51:08.491231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 247/485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:08.507005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:08.510761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:08.511538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Searching by: {'deleted': False, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1'} {{(pid=123637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 09 09:51:08.518456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.518900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.519696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.520125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.609987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.multi_cell_list [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 09 09:51:08.702133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5f7fbcac-da10-48dd-a6ca-3ae7e5f7d0d0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198746 May 09 09:51:08.702640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 239/486] 10.222.0.26 () {58 vars in 1124 bytes} [Mon May 9 09:51:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:08.713658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:08.714271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:08.720864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.721312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.722092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.722526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.865270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:08.876863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b17f37e7-5762-4d82-a878-9263a3ccbe96 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1547 microversion: 2.1 time: 0.167116 May 09 09:51:08.877600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 248/487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1547 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:08.925427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:08.926054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:08.932748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.933273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.934135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.934638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.937361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:08.938069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:08.944276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.944771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.945547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:08.945971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:08.962604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lazy-loading 'flavor' on Instance uuid 2129ee65-9b99-4722-9747-26e9e1419653 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:51:08.970580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2320c03f-25ff-4827-98eb-a4ef4da960a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/ips" status: 200 len: 146 microversion: 2.1 time: 0.036981 May 09 09:51:08.971375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 249/488] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 09:51:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:51:09.249227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02232360-ecef-4c1d-98c4-c55ccec0d289 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/action" status: 202 len: 0 microversion: 2.20 time: 0.327960 May 09 09:51:09.250115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 240/489] 10.222.0.26 () {62 vars in 1318 bytes} [Mon May 9 09:51:08 2022] POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 09:51:09.258983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:09.259614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:09.266146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:09.266698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:09.267559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:09.268020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:09.402116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:09.410462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:09.412009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:09.413237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4049fad4-3427-4c19-a7c4-c04869ae6e42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.158514 May 09 09:51:09.413854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 250/490] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:10.439321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:10.439882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:10.448610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:10.449092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:10.449870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:10.450304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:10.586363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:10.594806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:10.596263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:10.597496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-959ab83f-2c72-4452-b13b-e5c63db60bc0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.164265 May 09 09:51:10.598066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 241/491] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:11.474849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d27c057-3210-4a3e-bb02-7ef939eb6da7"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:11.476132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:11.486438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:11.486972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:11.488077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:11.488497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:11.617271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:11.617947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:11.625798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:11.626295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:11.627153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:11.627797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:11.761067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:11.769153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:11.770652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:11.771813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-269fa203-03fa-4774-a07c-859cf3ad431c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.158778 May 09 09:51:11.772381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 242/492] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:11.781677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4bcfefbf-2016-4f2c-95b0-d561c35777bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313135 May 09 09:51:11.782305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 251/493] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:51:11 2022] POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:12.320026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c71c8ec1-f2e6-4a5c-a9e1-8c8f74fbb324"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:12.321753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:12.331862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:12.332494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:12.333644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:12.334200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:12.649242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e66bfec7-d901-4981-a6b5-e10102fe5e27 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335871 May 09 09:51:12.649914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 243/494] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:51:12 2022] POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:12.793599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:12.794474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:12.802541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:12.802999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:12.803781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:12.804223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:12.942875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:12.955713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:12.957900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:12.959863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66bb3bf5-72f3-402b-8677-462dd3d90c9a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.172213 May 09 09:51:12.960774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 252/495] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:13.985183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:13.985931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:13.993065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:13.993515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:13.994276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:13.994702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:14.147986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:14.159337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:14.161283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:14.162763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-087e4390-63c0-413c-98c2-48ac4823fc11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.183022 May 09 09:51:14.163402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 244/496] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:15.184301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:15.184944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:15.191955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:15.192409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:15.193234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:15.193672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:15.336858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:15.348966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:15.350799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:15.352311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5e1528b-1024-4fb7-a8d5-435e368a816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.172210 May 09 09:51:15.353178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 253/497] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:16.374046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:16.374646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:16.381599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:16.382050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:16.382855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:16.383283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:16.533061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:16.542000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:16.543549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:16.544789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c5184c0a-229a-4be0-bf57-65679310a7c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.175089 May 09 09:51:16.545387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 245/498] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:17.564162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:17.564807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:17.572369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:17.572846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:17.573634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:17.574051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:17.715728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:17.724567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:17.726188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:17.727419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf7aee75-c84c-4cb7-ae3a-29b52cc15ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.167585 May 09 09:51:17.728002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 254/499] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:18.748754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:18.749410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:18.758983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:18.759646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:18.760824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:18.761266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:18.903677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:18.912196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:18.913702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:18.914886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b593a7b2-b768-496c-8f61-119500ccf29b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.171890 May 09 09:51:18.915489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 246/500] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:19.934326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:19.934961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:19.941723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:19.942169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:19.942944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:19.943363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:20.096948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:20.105321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:20.107274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:20.108631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5254202-ab67-438b-aba1-0120dd7772c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.178305 May 09 09:51:20.109295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 255/501] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:20.452730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:20.453554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:20.461171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:20.461624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:20.462409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:20.462846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:20.608378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:20.617694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-31ab2997-c775-4f73-ba7c-18267c4ffc5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1593 microversion: 2.1 time: 0.171455 May 09 09:51:20.618311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 247/502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1593 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:21.129311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:21.130416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:21.138699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:21.139297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:21.140247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:21.140900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:21.286793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:21.295409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:21.297097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:21.298301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28e7a40c-3499-43dc-b2ab-bcaebc4eb429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.174360 May 09 09:51:21.298880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 256/503] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:22.319907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:22.320539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:22.327502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:22.327992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:22.328808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:22.329234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:22.788184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:22.797052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:22.798586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:22.799844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-527ad414-be07-4adb-aff9-52ee50c0adcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.483879 May 09 09:51:22.800426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 248/504] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:23.248925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-b1a0a7cd-2b3a-40e1-9774-e3766cbfd88c req-de692954-d6bd-431e-8be7-e904c9b46cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:23.261111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b1a0a7cd-2b3a-40e1-9774-e3766cbfd88c req-de692954-d6bd-431e-8be7-e904c9b46cd6 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:23.262476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b1a0a7cd-2b3a-40e1-9774-e3766cbfd88c req-de692954-d6bd-431e-8be7-e904c9b46cd6 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:23.281020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-b1a0a7cd-2b3a-40e1-9774-e3766cbfd88c req-de692954-d6bd-431e-8be7-e904c9b46cd6 service nova] Creating event network-changed:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 09:51:23.289811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-b1a0a7cd-2b3a-40e1-9774-e3766cbfd88c req-de692954-d6bd-431e-8be7-e904c9b46cd6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044992 May 09 09:51:23.290769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 257/505] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:23.820484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:23.822455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:23.831032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:23.831972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:23.832838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:23.833264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:24.102724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:24.112540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:24.114711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:24.116152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bfaaf8de-df4c-4213-9e04-b1d6b4b30535 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.300569 May 09 09:51:24.116813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 249/506] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:24.464716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-479391809"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:24.465376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:24.473799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:24.474253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:24.475031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:24.475463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:24.611741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.network.security_group_api [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Adding security group f2af6155-0421-4118-93b2-647d5ae15abd to port aae37ee9-ba7e-4ac4-84da-717f219440f4 May 09 09:51:25.022393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e10af38d-5796-486e-acd9-9ae8744f1f1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/action" status: 202 len: 0 microversion: 2.1 time: 0.562753 May 09 09:51:25.024324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 258/507] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:51:24 2022] POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:51:25.033938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-5c7a3b95-8d11-4658-b18a-7390ad0441bc req-8590e5bf-7425-48af-8f6e-e62d8c26e7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:25.034832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:25.036014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:25.045239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-5c7a3b95-8d11-4658-b18a-7390ad0441bc req-8590e5bf-7425-48af-8f6e-e62d8c26e7bc service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:25.045864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-5c7a3b95-8d11-4658-b18a-7390ad0441bc req-8590e5bf-7425-48af-8f6e-e62d8c26e7bc service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:25.047948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:25.048611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:25.049620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:25.050211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:25.074997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-5c7a3b95-8d11-4658-b18a-7390ad0441bc req-8590e5bf-7425-48af-8f6e-e62d8c26e7bc service nova] Creating event network-changed:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 09:51:25.081276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-5c7a3b95-8d11-4658-b18a-7390ad0441bc req-8590e5bf-7425-48af-8f6e-e62d8c26e7bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050744 May 09 09:51:25.085188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 259/508] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:25.136502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:25.137503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:25.145068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:25.145991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:25.147022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:25.147705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:25.289387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:25.308572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e457965-88d9-4454-9fac-b1a60ee3a7bb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1757 microversion: 2.1 time: 0.279773 May 09 09:51:25.309812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 250/509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1757 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:25.345318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:25.363125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:25.365774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:25.367794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01097a7a-fd3e-48fd-a21e-896bf978c823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.235701 May 09 09:51:25.377145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 260/510] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:26.391598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:26.392254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:26.398908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:26.399359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:26.400504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:26.400990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:26.440338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51b9aaa8-128d-4377-9866-f702ff923c1f", "device": "/dev/sdb"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:26.441941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:26.449176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:26.449705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:26.450637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:26.451067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:26.548586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:26.557000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:26.558630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:26.559989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50a287c9-71ab-45fa-a52c-1a57f126b6fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1724 microversion: 2.20 time: 0.172369 May 09 09:51:26.560626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 251/511] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:27.579211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:27.579810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:27.586420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:27.586868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:27.587630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:27.588058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:27.737650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:27.747172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:27.749439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:27.750973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9dcd0754-c688-4a12-afe9-b78df8fe1f31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.175577 May 09 09:51:27.751618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 252/512] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:27.760627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e8c529c9-ad36-488f-b283-c98bde1affa3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "POST /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.324225 May 09 09:51:27.761562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 261/513] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:51:26 2022] POST /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df/os-volume_attachments => generated 194 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:28.681438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fb32ee45-d059-49da-a9bd-9a814797d7e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:28.688226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb32ee45-d059-49da-a9bd-9a814797d7e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:28.688815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb32ee45-d059-49da-a9bd-9a814797d7e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:28.749417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fb32ee45-d059-49da-a9bd-9a814797d7e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Going to try to stop instance {{(pid=123637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 09 09:51:28.772772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:28.773519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:28.780396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:28.781112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:28.781922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:28.782357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:28.794366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fb32ee45-d059-49da-a9bd-9a814797d7e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/action" status: 202 len: 0 microversion: 2.1 time: 0.116486 May 09 09:51:28.795917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 253/514] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:51:28 2022] POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:51:28.806406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:28.807107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:28.814376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:28.814902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:28.815747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:28.816245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:28.932049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:28.940921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:28.942687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:28.944050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-571933da-d253-40de-b8c2-30bf680220a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.176355 May 09 09:51:28.944692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 262/515] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:28.966523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:28.974520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f62ab967-8341-4769-a081-9fd27fc5e345 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.172236 May 09 09:51:28.975094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 254/516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:29.965871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:29.966743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:29.975815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:29.976336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:29.977144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:29.977577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:29.993612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:29.994226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:30.000927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:30.001411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:30.002206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:30.002635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:30.125932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:30.134765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:30.136241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:30.137513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aebc2253-31d0-44b5-af54-5d2d77752768 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.178118 May 09 09:51:30.138079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 263/517] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:30.156868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:30.165016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57a3ad41-f66b-4537-8a13-dca38e20a0ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.175771 May 09 09:51:30.165677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 255/518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:51:31.159218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:31.159851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:31.166749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:31.167238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:31.168155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:31.168634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:31.184507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:31.186152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:31.194149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:31.194598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:31.195626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:31.196183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:31.333965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:31.344779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:31.346470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:31.347666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8d6d8e7-5ba4-4668-8c7a-6faecd7db898 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.192569 May 09 09:51:31.348236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 264/519] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:31.354647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-d129e0f2-dd69-4e5c-ae4e-dcbcd0293437 req-b0ff77bb-9914-4ff7-b02c-72a26fd496f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "name": "network-vif-plugged", "status": "completed", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:31.360863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:31.365645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d129e0f2-dd69-4e5c-ae4e-dcbcd0293437 req-b0ff77bb-9914-4ff7-b02c-72a26fd496f4 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:31.366089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-d129e0f2-dd69-4e5c-ae4e-dcbcd0293437 req-b0ff77bb-9914-4ff7-b02c-72a26fd496f4 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:31.369235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9b961660-8649-40bd-bf27-0480b618274d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.189651 May 09 09:51:31.369800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 256/520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:31.378042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-d129e0f2-dd69-4e5c-ae4e-dcbcd0293437 req-b0ff77bb-9914-4ff7-b02c-72a26fd496f4 service nova] Creating event network-vif-plugged:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 09:51:31.385352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-d129e0f2-dd69-4e5c-ae4e-dcbcd0293437 req-b0ff77bb-9914-4ff7-b02c-72a26fd496f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035813 May 09 09:51:31.385967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 265/521] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:32.367618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:32.368252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:32.374967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:32.375406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:32.376168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:32.376593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:32.392930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:32.394017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:32.404934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:32.405386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:32.406160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:32.406591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:32.509350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:32.517827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:32.519422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:32.520581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c55968e8-bc85-4b9a-8728-13cf8005702f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.156889 May 09 09:51:32.521208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 257/522] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:32.541531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:32.550499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba1e5fcd-3120-48fc-abe2-fbe933b65430 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.165750 May 09 09:51:32.551068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 266/523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:33.540260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:33.540956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:33.547931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:33.548491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:33.549425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:33.549889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:33.568194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:33.568782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:33.575943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:33.576388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:33.577228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:33.577652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:33.688993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:33.697367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:33.698883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:33.700033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ea453a6-331e-4884-a2e4-a0887eb131f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.164166 May 09 09:51:33.700634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 258/524] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:33.723295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:33.731778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-52a4f110-814c-4f2a-a20e-d93e8d3e7261 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.168306 May 09 09:51:33.732417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 267/525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:34.720926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:34.721590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:34.728321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:34.728792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:34.729556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:34.730329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:34.753116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:34.754664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:34.761756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:34.762351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:34.763620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:34.764275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:34.870052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:34.878131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:34.879626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:34.880803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-791b81cd-35d7-418f-81a2-a233a27fc482 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.164215 May 09 09:51:34.881587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 259/526] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:34.901425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:34.909817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4cb11bcd-c36c-4ff3-a5c8-0b8e2ecbc990 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.162350 May 09 09:51:34.910386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 268/527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:35.899524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:35.900167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:35.906832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:35.907275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:35.908055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:35.908489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:35.927143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:35.928415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:35.935128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:35.935608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:35.936411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:35.936877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:36.058186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:36.069439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:36.071660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:36.073098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e147a8a-515c-4630-884e-97475dbc2410 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1745 microversion: 2.20 time: 0.177263 May 09 09:51:36.073895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 260/528] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:36.088896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:36.104546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2daf11e9-1126-44c6-a1b7-404a9f0f912b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.174284 May 09 09:51:36.104546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 269/529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:51:37.101974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:37.103686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:37.115508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:37.118011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:37.129936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:37.130436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:37.130945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:37.131519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:37.131744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:37.132509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:37.133447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:37.133890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:37.298992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:37.309414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8fed6bd6-c3ce-4fe2-90f4-2cd64932867b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.197247 May 09 09:51:37.310459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 270/530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:37.334756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:37.344301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:37.345816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:37.346979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50dfab32-c93e-4323-a22f-72523c237779 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.249297 May 09 09:51:37.347550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 261/531] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:38.327253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:38.328044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:38.335910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:38.336357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:38.337181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:38.337611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:38.369108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:38.369824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:38.376950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:38.377519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:38.378321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:38.378786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:38.492335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:38.501579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4498313-5416-41cc-b252-7f1679b97895 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.178294 May 09 09:51:38.502185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 271/532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:38.550944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:38.563152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:38.564911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:38.566136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f98d6173-a620-408b-9b71-373e8b41cefc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.201179 May 09 09:51:38.566714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 262/533] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:39.519197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:39.520506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:39.532069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:39.532517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:39.533334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:39.533762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:39.584493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:39.586001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:39.593228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:39.593680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:39.594454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:39.594879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:39.723362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:39.734667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82633edb-8564-40be-9f3e-27eb942b25b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.219318 May 09 09:51:39.745755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 272/534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:39.756294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:39.766991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:39.771460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:39.773558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9814b46-1330-4f16-a7df-1185f76776d5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.193401 May 09 09:51:39.774138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 263/535] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:51:40.753162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:40.754456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:40.764375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:40.765171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:40.765954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:40.766392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:40.792984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:40.794483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:40.803140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:40.803707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:40.804720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:40.805216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:40.942536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:40.954056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99851081-9100-430d-947c-dadc18d52ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.206202 May 09 09:51:40.954838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 273/536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:40.975216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:40.984194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:40.985833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:40.987558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-724707ef-0e5f-48f3-aeba-d61d46eef208 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.198729 May 09 09:51:40.998993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 264/537] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:41.982203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:41.982890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:42.004748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:42.005286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:42.006117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:42.006557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:42.006689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:42.007262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:42.014451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:42.015380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:42.016597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:42.017296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:42.179310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:42.187165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:42.187492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:42.189232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:42.190768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f024ae8f-a20a-45f0-b982-caea35b44b3c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.188048 May 09 09:51:42.191911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 265/538] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:42.196441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dceb55b6-7857-4d7e-85fd-9f424f1d60c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.228158 May 09 09:51:42.204296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 274/539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:43.210228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:43.211815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:43.221312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:43.222773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:43.233137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:43.233790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:43.234459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:43.235305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:43.235744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:43.236393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:43.237456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:43.241001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:43.410974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:43.419779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:43.423922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:43.427103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2d44c705-9e55-4892-bef6-2e4f6b7999f2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.220459 May 09 09:51:43.428422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 266/540] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:43.450545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:43.459044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f8f5946-0303-4868-acd5-f0a0666b0276 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.242282 May 09 09:51:43.469016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 275/541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:44.449626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:44.450262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:44.463805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:44.465765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:44.466922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:44.467635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:44.485413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:44.486844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:44.500423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:44.502309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:44.503552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:44.504169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:44.659927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:44.671871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:44.674074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:44.675595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8abf38a-e22c-4bfe-8c09-9956706b458c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.233008 May 09 09:51:44.676761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 267/542] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:44.705682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:44.716611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0269416d-2f33-41d0-82cd-1d0fda6412a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.238277 May 09 09:51:44.717329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 276/543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:45.695035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:45.695725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:45.702777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:45.703228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:45.704004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:45.704434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:45.735075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:45.735770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:45.742667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:45.743114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:45.743907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:45.744333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:45.857308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:45.865541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:45.867031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:45.868196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b72c0fff-8dc2-4e06-9f2e-5bdbd050cb23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.177397 May 09 09:51:45.868783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 268/544] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:45.893137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:45.901431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-846215ef-8b7d-42d7-bd74-18055fcf34e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.170315 May 09 09:51:45.902010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 277/545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:46.888278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:46.888913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:46.897511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:46.897959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:46.898747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:46.899178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:46.920492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:46.920492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:46.927105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:46.927592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:46.928377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:46.928836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:47.044174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:47.053041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:47.054535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:47.055731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f5b01f48-84ff-47db-8ef0-973edc1e81de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.172667 May 09 09:51:47.056525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 269/546] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:47.079953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:47.088366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f60897d9-63d7-491f-a937-3a274b28c43d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.172841 May 09 09:51:47.089021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 278/547] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:48.074854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:48.075454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:48.082339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:48.082818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:48.083561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:48.084019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:48.107488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:48.108195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:48.114829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:48.115322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:48.116070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:48.116616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:48.230886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:48.239945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:48.242033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:48.243529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf5655f4-963c-48d5-9f05-221d1ac69776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1740 microversion: 2.20 time: 0.172734 May 09 09:51:48.244889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 270/548] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:48.267263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:48.278909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e01d62ab-a656-45ab-8927-d214f5e1a1ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.175424 May 09 09:51:48.279790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 279/549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:51:49.267408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:49.268301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:49.275653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:49.276099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:49.276955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:49.277380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:49.297106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:49.299096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:49.306072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:49.306522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:49.307320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:49.307756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:49.426752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:49.443696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:49.445276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:49.446450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-839b7bc2-3d7c-428f-9fad-34d5a573c9f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1722 microversion: 2.20 time: 0.183434 May 09 09:51:49.447137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 271/550] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:49.451606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:49.461685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d6c804f-a490-4c4e-9574-7a4ab2a97e0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.169298 May 09 09:51:49.462276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 280/551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:50.465761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:50.466439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:50.475112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:50.475578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:50.476363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:50.476832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:50.478962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:50.479927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:50.486889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:50.487432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:50.488150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:50.488578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:50.617500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:50.626518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:50.628076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:50.629239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b1329704-f821-46fe-a63c-303e26489a8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1722 microversion: 2.20 time: 0.167469 May 09 09:51:50.629837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 272/552] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:50.631415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:50.639880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a88907e8-a6b4-454d-8405-0b12cfaf0af4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.164790 May 09 09:51:50.640723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 281/553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:51.649120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:51.649743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:51.656948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:51.657399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:51.657733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:51.658433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:51.658593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:51.658754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:51.665346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:51.665797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:51.666578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:51.667012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:51.799948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:51.808200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:51.810252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:51.811174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-30be94e0-223e-4536-b74b-5942b51eb920 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1722 microversion: 2.20 time: 0.166307 May 09 09:51:51.811698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 273/554] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:51.819584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:51.827909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21be3168-aec9-4af7-a2c1-3eb811e8b5e7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.174084 May 09 09:51:51.828477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 282/555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:51:52.498609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-5fd87c77-48ca-4124-b1bb-77f159d5c8fc req-d6f3e3ed-09c9-41ac-847b-1fce0d7f6f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "name": "network-vif-unplugged", "status": "completed", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:52.506978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5fd87c77-48ca-4124-b1bb-77f159d5c8fc req-d6f3e3ed-09c9-41ac-847b-1fce0d7f6f54 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:52.507436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5fd87c77-48ca-4124-b1bb-77f159d5c8fc req-d6f3e3ed-09c9-41ac-847b-1fce0d7f6f54 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:52.522349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-5fd87c77-48ca-4124-b1bb-77f159d5c8fc req-d6f3e3ed-09c9-41ac-847b-1fce0d7f6f54 service nova] Creating event network-vif-unplugged:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 09:51:52.527583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-5fd87c77-48ca-4124-b1bb-77f159d5c8fc req-d6f3e3ed-09c9-41ac-847b-1fce0d7f6f54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032784 May 09 09:51:52.528536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 274/556] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:51:52.831038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:52.831785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:52.839160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:52.839584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:52.840514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:52.840998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:52.846755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:52.847471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:52.853898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:52.854358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:52.855734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:52.856368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:53.063081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:53.072171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-80422922-d7b7-4473-89b9-2cc27f0ec97c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.230024 May 09 09:51:53.072806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 275/557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:53.226329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:53.235633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:53.237133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:53.238376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c6f7bdf-d0e6-4600-abd7-cf757fd74d22 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1722 microversion: 2.20 time: 0.411966 May 09 09:51:53.239172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 283/558] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:54.092848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:54.093506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:54.100501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:54.100987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:54.101786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:54.102217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:54.240550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:54.249672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1be0d36-c39b-4d50-8874-74a98827bb17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.162960 May 09 09:51:54.250251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 276/559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:54.256146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:54.256800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:54.263547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:54.263980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:54.264843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:54.265288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:54.405144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:54.414173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:54.415670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:54.416875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e622f3b-c4e6-44ca-b51c-91dae4675df8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1722 microversion: 2.20 time: 0.164634 May 09 09:51:54.417425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 284/560] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:55.267462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:55.268048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:55.274924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:55.275377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:55.276148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:55.276590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:55.416941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:55.425418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1500032a-00fd-48e8-bbd9-7e68803a396d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.162063 May 09 09:51:55.425996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 277/561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:55.435502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:55.436111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:55.442848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:55.443299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:55.444072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:55.444504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:55.598104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:55.607055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:55.608568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:55.610362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9825581f-a45f-4e21-808c-dc98df505658 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1725 microversion: 2.20 time: 0.178585 May 09 09:51:55.610981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 285/562] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:55.628627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6bd883b-a2da-4446-91ac-a1cccde89d18"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:55.629709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:55.635788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:55.636229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:55.637014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:55.637440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:55.977442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ef8b6e3b-201a-4732-9fb7-e50c05c787d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.352886 May 09 09:51:55.978052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 278/563] 10.222.0.26 () {62 vars in 1363 bytes} [Mon May 9 09:51:55 2022] POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:51:56.096073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:56.096650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:56.103776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.104698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.105655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.106706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.213861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-132b4c73-8687-476f-98d2-78612a1aa511 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/action" status: 202 len: 0 microversion: 2.20 time: 0.118106 May 09 09:51:56.213861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 286/564] 10.222.0.26 () {62 vars in 1318 bytes} [Mon May 9 09:51:56 2022] POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 09:51:56.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:56.220864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:56.227468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.227917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.228676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.229110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.366213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:56.380406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:56.382390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:56.383594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-244ff217-ef7b-4f9a-99d7-b288c9716b3f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1751 microversion: 2.20 time: 0.168297 May 09 09:51:56.384304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 279/565] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:56.443023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:56.443638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:56.454558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.455090 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.455958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.456455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.614664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:56.626937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec44728b-67e8-4e03-b300-0a986008c737 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.188125 May 09 09:51:56.633713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 287/566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:56.865213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:56.865727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:56.873426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.873908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:56.874701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:56.875134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:57.023805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'services' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:51:57.168136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-228c8885-684e-4c02-9c1e-4c71525e2d7b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df/os-volume_attachments/51b9aaa8-128d-4377-9866-f702ff923c1f" status: 202 len: 0 microversion: 2.1 time: 0.306910 May 09 09:51:57.168794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 280/567] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:51:56 2022] DELETE /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df/os-volume_attachments/51b9aaa8-128d-4377-9866-f702ff923c1f => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:51:57.405101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:57.405608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:57.412949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:57.413396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:57.414174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:57.414604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:57.546371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:57.555520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:57.557144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:57.558393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b30baca8-7210-4efa-97f3-8ff295661f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1751 microversion: 2.20 time: 0.159075 May 09 09:51:57.558958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 288/568] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:57.645877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:57.646546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:57.654173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:57.654618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:57.655526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:57.656197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:57.799471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:57.812304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e91c5ef-ec43-44dc-9911-d4158002f23f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1724 microversion: 2.1 time: 0.171361 May 09 09:51:57.812899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 281/569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:58.577883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:58.578464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:58.585340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:58.585787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:58.586567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:58.587021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:58.723567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:58.733075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:58.734565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:58.735717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f67bf2b6-30e0-4020-9cd8-b1adb7e6a5c5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1753 microversion: 2.20 time: 0.161849 May 09 09:51:58.736418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 289/570] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:51:58.829947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:58.830599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:58.837467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:58.837924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:58.838698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:58.839131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:58.977969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:58.986762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd40b71e-969c-405b-b92d-9b61febaaf21 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1701 microversion: 2.1 time: 0.160775 May 09 09:51:58.987353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 282/571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:59.003945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b65b5f26-8925-4184-8163-ec793fd8311a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:51:59.010694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b65b5f26-8925-4184-8163-ec793fd8311a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.011181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b65b5f26-8925-4184-8163-ec793fd8311a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.076156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b65b5f26-8925-4184-8163-ec793fd8311a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Going to try to start instance {{(pid=123638) start /opt/stack/nova/nova/compute/api.py:2730}} May 09 09:51:59.124687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b65b5f26-8925-4184-8163-ec793fd8311a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/action" status: 202 len: 0 microversion: 2.1 time: 0.124472 May 09 09:51:59.125338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 290/572] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:51:58 2022] POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:51:59.134245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:59.135019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:59.141899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.142484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.143397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.143943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.283311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:59.291366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a40afc55-7d39-4bef-b0e9-e893eb0cbbb5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1710 microversion: 2.1 time: 0.161372 May 09 09:51:59.292160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 283/573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:59.367216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:59.367898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:59.375734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.376291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.377170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.377655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.406473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 09:51:59.486799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b1b9506-bdf7-400b-a1dc-a381913bbb71 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 204 len: 0 microversion: 2.1 time: 0.123631 May 09 09:51:59.487388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 291/574] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 09:51:59 2022] DELETE /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 09:51:59.495592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:59.496209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:59.502414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.502874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.503652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.504087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.638892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:59.646534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da1f57cf-8264-4bc5-b70b-5e707fede420 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1514 microversion: 2.1 time: 0.154761 May 09 09:51:59.647098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 284/575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:51:59 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:51:59.762939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:51:59.766080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:51:59.772934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.773391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.774168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:51:59.774598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:51:59.918358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:59.927711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:59.929238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:51:59.930398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-08528173-cd69-4316-a421-c88204a18de0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.178149 May 09 09:51:59.930961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 292/576] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:51:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:00.312015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:00.312686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:00.319363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:00.319811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:00.320572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:00.321033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:00.451540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:00.459776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cac95fe5-0db0-4f67-9319-5dae544ef1f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1710 microversion: 2.1 time: 0.153153 May 09 09:52:00.460708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 285/577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1710 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:00.666839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:00.667717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:00.675006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:00.675441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:00.676209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:00.676637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:00.813650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:00.821680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3454fa0b-177d-445c-a651-a0c8bbbf84ad tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1514 microversion: 2.1 time: 0.161514 May 09 09:52:00.822273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 293/578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:00 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:00.951156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:00.951655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:00.958265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:00.958718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:00.959484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:00.959908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:01.098924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:01.108113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:01.109629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:01.110793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6fa45bb-03ba-4401-ad92-c4311a1269d2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164911 May 09 09:52:01.111337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 286/579] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:01.480238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:01.481091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:01.487721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:01.488322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:01.489380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:01.489877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:01.624709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:01.632694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7de09437-0627-43a3-90a3-e6026269bfc3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1710 microversion: 2.1 time: 0.159868 May 09 09:52:01.633263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 294/580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:01.839428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:01.840030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:01.846891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:01.847332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:01.848135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:01.848527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:02.074355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:02.082569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f52152b-43b5-483f-9c0a-f59791cf4b17 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1514 microversion: 2.1 time: 0.247055 May 09 09:52:02.092046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 287/581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:01 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:02.131626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:02.132485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:02.139290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:02.139860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:02.140777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:02.141829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:02.406512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:02.415522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:02.417061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:02.418217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd2c81f2-e00c-4e05-b115-1dc56508badf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.291490 May 09 09:52:02.418782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 295/582] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:02.650214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:02.650838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:02.657733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:02.658261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:02.659740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:02.660256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:02.664097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-f1652279-682d-4ad2-82e2-033bff8474fe req-7f5e9500-5ff7-424e-8583-e0bfb1911af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2621882-622c-44e5-8ea9-9b702f9079df", "name": "network-vif-deleted", "tag": "48d28e6a-7797-49da-a9c8-8d48d4516fd4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:52:02.672208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f1652279-682d-4ad2-82e2-033bff8474fe req-7f5e9500-5ff7-424e-8583-e0bfb1911af9 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:02.672695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f1652279-682d-4ad2-82e2-033bff8474fe req-7f5e9500-5ff7-424e-8583-e0bfb1911af9 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:02.684380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-f1652279-682d-4ad2-82e2-033bff8474fe req-7f5e9500-5ff7-424e-8583-e0bfb1911af9 service nova] Creating event network-vif-deleted:48d28e6a-7797-49da-a9c8-8d48d4516fd4 for instance c2621882-622c-44e5-8ea9-9b702f9079df on hv-cinder-84108 May 09 09:52:02.689841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-f1652279-682d-4ad2-82e2-033bff8474fe req-7f5e9500-5ff7-424e-8583-e0bfb1911af9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 May 09 09:52:02.690455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 296/583] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:52:02.811544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:02.820153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-69b9122a-0d97-4e39-898e-49fc6534766a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1710 microversion: 2.1 time: 0.173702 May 09 09:52:02.820562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 288/584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:03.100192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:03.100828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:03.107679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.108123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.108977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.109420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.142321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.142998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.143216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:03.187883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:03.195634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ffce898c-3b72-45b4-ac46-11db9d7d4c6e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.099792 May 09 09:52:03.196146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 297/585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:03 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:03.436428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:03.437103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:03.443940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.444385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.445191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.445620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.597814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:03.606860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:03.608354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:03.609546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f43aa12-2540-41ba-b50f-4c38173063d4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.177270 May 09 09:52:03.610102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 289/586] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:03.837927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:03.838572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:03.845157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.845609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.846393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:03.846829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:03.984531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:03.993111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea1fc68d-dbc9-48d8-9044-485d14263d4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1714 microversion: 2.1 time: 0.159106 May 09 09:52:03.993704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 298/587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:04.218163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:04.218982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:04.225479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:04.226062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:04.226943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:04.227577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:04.259183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:04.259648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:04.260058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:04.306051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:04.314125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b971106c-4910-4535-ae35-bdd0a44d5acf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.100235 May 09 09:52:04.314721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 290/588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:04 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:04.628458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:04.629084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:04.636270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:04.636751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:04.637512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:04.638169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:04.777160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:04.786003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:04.787575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:04.788839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6850320-4152-46a1-b4d9-3405cc72da96 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164478 May 09 09:52:04.789437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 299/589] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:05.330737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:05.331443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:05.338627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:05.339112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:05.340286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:05.340983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:05.378514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:05.378959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:05.379407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:05.420899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:05.428773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-344131b6-e6a8-4532-8beb-22fa0496f451 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.101928 May 09 09:52:05.429354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 291/590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:05 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:05.808158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:05.809968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:05.817725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:05.818286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:05.819066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:05.819529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:05.963806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:05.977764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:05.979579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:05.980764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af1d3e8a-492d-48c5-8763-f7ac84ef31ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.176924 May 09 09:52:05.981445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 300/591] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:06.446467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:06.447095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:06.454376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:06.454858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:06.455654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:06.456113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:06.507432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:06.507916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:06.508369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:06.550875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:06.561944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cdfdab5b-f153-46a8-befb-78b97c974e4a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.119432 May 09 09:52:06.562932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 292/592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:06 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:07.002515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:07.003289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:07.010423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:07.010976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:07.011850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:07.012374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:07.153052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:07.161922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:07.163456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:07.164637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc3b6d73-f1ed-4a06-82a7-019226d5d451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.166491 May 09 09:52:07.165459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 301/593] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:07.578979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:07.579651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:07.589348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:07.589824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:07.590799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:07.591213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:07.630855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:07.631377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:07.631743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:07.681044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:07.690058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e65986d-0884-415d-b6dd-4fffeef1c874 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.114930 May 09 09:52:07.696293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 293/594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:07 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:08.183608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:08.184372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:08.190789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:08.191231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:08.191996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:08.192426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:08.328786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:08.337736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:08.339233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:08.340413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1be77ce-e995-4325-9a9c-844bd4a58804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.160833 May 09 09:52:08.341077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 302/595] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:08.707379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:08.708035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:08.717836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:08.718470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:08.719550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:08.720089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:08.753636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:08.754082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:08.754531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:08.796293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:08.804177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7fc2678d-8296-4a55-9723-1a5a658664d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.101442 May 09 09:52:08.804751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 294/596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:08 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:09.359630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:09.360358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:09.367179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:09.367630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:09.368405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:09.368942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:09.510848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:09.525641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:09.527183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:09.528423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e4fb5265-3d04-49d8-93f9-2cd73a49f0fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.172970 May 09 09:52:09.533937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 303/597] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:09.823020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:09.823958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:09.831970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:09.832419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:09.833242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:09.833677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:09.867859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:09.868297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:09.868776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:09.909980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:09.918673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b08316e9-dc93-4f8c-b2ee-90a90541fd0e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.099875 May 09 09:52:09.919269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 295/598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:09 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:10.552979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:10.553645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:10.561338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:10.561338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:10.561951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:10.562394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:10.701795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:10.711082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:10.712960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:10.714171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-adee476b-57bd-407a-bda8-f1af788a73a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.168953 May 09 09:52:10.715844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 304/599] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:10.935749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:10.936439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:10.943165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:10.943610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:10.944388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:10.944844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:10.980714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:10.981171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:10.981639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:11.030893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:11.038718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d112ae70-61d9-41ae-88cd-c9b94bbed3d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.107054 May 09 09:52:11.039282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 296/600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:10 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:11.734339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:11.734995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:11.741805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:11.742245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:11.743019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:11.743435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:11.890427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:11.900305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:11.902118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:11.903763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1e76dd5a-f883-4143-88d0-c4aa6139b268 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.173673 May 09 09:52:11.904971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 305/601] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:12.056231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:12.057756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:12.064900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:12.065438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:12.067466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:12.067466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:12.099220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:12.099559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:12.100029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:12.152518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:12.160992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd5d0da9-ba36-4709-846a-4b67a369dd81 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.108726 May 09 09:52:12.161633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 297/602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:12 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:52:12.922990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:12.923676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:12.930414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:12.930857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:12.931629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:12.932085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:13.071854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:13.080352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:13.081873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:13.083073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-427f86ea-8eae-46f2-b5e0-581cf10e8743 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164103 May 09 09:52:13.083612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 306/603] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:13.179256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:13.179874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:13.186229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:13.186669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:13.187425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:13.187845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:13.222503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:13.222957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:13.223368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:13.266303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:13.274599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9606b589-924b-4679-983d-e61523b51cbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.099337 May 09 09:52:13.275511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 298/604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:13 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:14.108156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:14.109884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:14.118574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:14.119110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:14.120099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:14.120568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:14.263437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:14.272411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:14.274005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:14.275190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9aec4359-70df-494e-8c53-d545ae56dec7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.172976 May 09 09:52:14.276273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 307/605] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:14.291626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:14.292304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:14.299259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:14.299711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:14.300492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:14.300957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:14.333995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:14.334509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:14.335068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:14.377475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:14.385157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b21f3e54-c2b7-4da6-9a62-66808cb6b0a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.097578 May 09 09:52:14.385724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 299/606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:14 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:15.299641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:15.300727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:15.310658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:15.311180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:15.311946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:15.312373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:15.402459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:15.403103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:15.409705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:15.410161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:15.410938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:15.411368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:15.443038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:15.444698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:15.445176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:15.445640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:15.452071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:15.453610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:15.454804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-615d05f7-59ce-4198-ae09-22a7fb07e6f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.161463 May 09 09:52:15.455352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 308/607] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:15.490369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:15.498483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0686c3b-8c0f-43a9-9464-1afd7689673a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.099838 May 09 09:52:15.499040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 300/608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:15 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:16.474016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:16.474674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:16.482100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:16.482617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:16.483435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:16.483901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:16.519635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:16.519635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:16.526987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:16.527505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:16.528305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:16.528775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:16.561639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:16.562147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:16.563203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:16.608414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:16.616782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da451e1a-87c8-4fe7-bd8c-87182cb95795 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.102185 May 09 09:52:16.617349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 301/609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:16 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:52:16.625612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:16.634760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:16.636267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:16.637448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ab80999-b594-44b9-b2d9-e98d3c93b000 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.167506 May 09 09:52:16.638001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 309/610] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:52:17.634812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:17.635415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:17.642310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:17.642750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:17.643513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:17.643944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:17.656102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:17.656749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:17.664481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:17.665178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:17.666052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:17.666572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:17.680310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:17.680310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:17.680765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:17.780964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:17.791138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-36c64577-7cbe-40de-9685-6c2ac3b38823 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.161048 May 09 09:52:17.792045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 302/611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:17 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:17.863863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:17.872447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:17.873983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:17.875141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-69c4c550-4205-4d70-a51c-f0c27dedcffa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.223281 May 09 09:52:17.876442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 310/612] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:18.812441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:18.813067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:18.819869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:18.820313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:18.821112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:18.821531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:18.855593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:18.856035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:18.856469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:18.895353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:18.896121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:18.899086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:18.902867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:18.903326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:18.904074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:18.904613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:18.907047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e064c6cb-88dd-4110-8e53-a4f429c1f452 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.098733 May 09 09:52:18.907652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 303/613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:18 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:19.041010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:19.049989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:19.051489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:19.052682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fbb95a96-0d2c-4f9a-834c-cc5d79d627b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.161762 May 09 09:52:19.053262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 311/614] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 09:52:19.923940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:19.924587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:19.931481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:19.931932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:19.932799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:19.933232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:19.965594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:19.966035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:19.966487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'fault' on Instance uuid c2621882-622c-44e5-8ea9-9b702f9079df {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:52:20.008331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:20.016241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-197a4f41-89ec-44fd-bef1-bfa5648daffe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 200 len: 1309 microversion: 2.1 time: 0.096475 May 09 09:52:20.016847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 304/615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:19 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:20.071935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:20.072568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:20.079558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:20.079992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:20.080807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:20.081237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:20.213245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:20.222308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:20.223796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:20.224994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6254dfe8-54ba-41ad-9c07-bb1b8567872d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.157009 May 09 09:52:20.225552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 312/616] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:21.034707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:21.035357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: c2621882-622c-44e5-8ea9-9b702f9079df] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:21.042250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:21.042683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:21.043455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:21.043890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:21.057682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] HTTP exception thrown: Instance c2621882-622c-44e5-8ea9-9b702f9079df could not be found. May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Request method failure captured: May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df HTTP/1.1 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOPZgQqgFypzC-vfKjyWf5-WrWQe7QWEoDIj1YMlewhejJTkoc3u0bLwOXU2Ij5F3OaY8ffR7xhBoRbfkHP0tcLHrmLvwkj9kndJ8yXtooHWZiQLTO2pF9PY-ly7pOTdW2BPH6pRjNlNeIKXSvMBhCBlb77xpqsZcd7zAxWyXki38P8 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:52:21.059378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_084ec4bab56b4c1d823158e34705bbf0", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017941071 May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 17a673de26884004bc852ef76b18aa06 May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance c2621882-622c-44e5-8ea9-9b702f9079df could not be found. May 09 09:52:21.060981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'c2621882-622c-44e5-8ea9-9b702f9079df'} May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2621882-622c-44e5-8ea9-9b702f9079df could not be found. May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:52:21.061782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2621882-622c-44e5-8ea9-9b702f9079df could not be found. May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2621882-622c-44e5-8ea9-9b702f9079df could not be found. May 09 09:52:21.063016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:52:21.064132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Returning 404 to user: Instance c2621882-622c-44e5-8ea9-9b702f9079df could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:52:21.064132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15f9c3c1-bbca-4b64-9a76-a43954684ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df" status: 404 len: 111 microversion: 2.1 time: 0.030011 May 09 09:52:21.064132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 305/617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:21 2022] GET /compute/v2.1/servers/c2621882-622c-44e5-8ea9-9b702f9079df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 09:52:21.243721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:21.244317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:21.250898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:21.251346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:21.252246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:21.252571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:21.389927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:21.398810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:21.400305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:21.401521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09d4965e-dcf2-439d-a066-14c03726d0ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.161990 May 09 09:52:21.402076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 313/618] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:22.420623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:22.421304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:22.428275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:22.428767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:22.429552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:22.429994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:22.574076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:22.583133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:22.584684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:22.585850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19650a11-6b67-4f68-8b79-6a81ef97d7af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.169349 May 09 09:52:22.586415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 306/619] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:23.607052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:23.607649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:23.616445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:23.616923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:23.617729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:23.618156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:23.773105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:23.782828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:23.784321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:23.785527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01e82b5c-ca39-4220-937b-e8e197e08a1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.182803 May 09 09:52:23.786098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 314/620] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:24.912071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:24.912651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:24.919193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:24.919633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:24.920407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:24.920862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:24.989908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:52:24.990193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 09:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 (ip 10.222.0.26) !!! May 09 09:52:25.058058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:25.068160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:25.069688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:25.070814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b07be120-a437-4423-b0d4-d354289e3691 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.269350 May 09 09:52:25.071621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 307/621] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:26.089890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:26.090466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:26.097411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:26.097853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:26.098626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:26.099059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:26.239714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:26.248362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:26.249953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:26.251100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb683d82-e8ad-44da-bd25-df9b4d6f2c8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.165238 May 09 09:52:26.251666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 315/622] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:27.275374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:27.276051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:27.282916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:27.283364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:27.284147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:27.284587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:27.422818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:27.432641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:27.434193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:27.435401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8f64c563-190e-4e7e-b346-666c68c64467 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164083 May 09 09:52:27.435985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 308/623] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:28.454643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:28.455208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:28.462390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:28.462841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:28.463607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:28.464047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:28.598852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:28.611824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:28.614040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:28.615782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-642438a7-a1e1-455f-878f-7926666964d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.165126 May 09 09:52:28.616521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 316/624] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:29.635004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:29.635633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:29.642674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:29.643122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:29.643911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:29.644345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:29.777807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:29.786529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:29.788043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:29.789259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9216d5b9-04db-4cf6-8c23-b2b8ec065336 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.158292 May 09 09:52:29.789888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 309/625] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:30.809865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:30.810497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:30.817468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:30.817816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:30.818652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:30.819116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:30.952853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:30.962132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:30.963637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:30.964874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64d94a5a-a891-45d6-853a-65478b04f37d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.160784 May 09 09:52:30.965449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 317/626] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:31.984271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:31.985360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:31.995214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:31.995658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:31.996502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:31.996967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:32.132488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:32.141982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:32.143543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:32.144745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf240932-519b-4fdb-9070-3e1d13b5a4a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164590 May 09 09:52:32.145306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 310/627] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:33.028835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1609576559", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "networks": [{"uuid": "a38514dd-d2b0-4658-99b8-ef1afc68db93"}]}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:52:33.081972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] validate_networks() for [('a38514dd-d2b0-4658-99b8-ef1afc68db93', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 09:52:33.163885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:33.164516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:33.171510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:33.171965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:33.172795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:33.173320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:33.319466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:33.328159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:33.329710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:33.330981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c82da720-424d-4b7d-80e9-91e8c6220d73 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.171153 May 09 09:52:33.331586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 311/628] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:33.493849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 09:52:33.494269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 09:52:33.494749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 09:52:33.495191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 09:52:33.495599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 09:52:33.506128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:33.506578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:33.507401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:33.507823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:33.527981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Getting quotas for project 084ec4bab56b4c1d823158e34705bbf0. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 09:52:33.532156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Getting quotas for user 17a673de26884004bc852ef76b18aa06 and project 084ec4bab56b4c1d823158e34705bbf0. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 09:52:33.544128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 09:52:33.546548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 09:52:33.589972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f23ae0a-9a18-4507-b9c7-1a9fd410de55 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565020 May 09 09:52:33.590610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 318/629] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 09:52:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 09:52:33.607308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2445a648-960f-4b13-9294-5dd80b4e78f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:33.608343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2445a648-960f-4b13-9294-5dd80b4e78f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:33.663238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2445a648-960f-4b13-9294-5dd80b4e78f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:33.670167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2445a648-960f-4b13-9294-5dd80b4e78f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1219 microversion: 2.1 time: 0.070191 May 09 09:52:33.670777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 312/630] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:33 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:34.322172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-8c6d388f-4dc9-4a08-bef5-4376196cd5e5 req-9b5fa099-d898-4106-85c1-a1dadb1ad293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "name": "network-vif-plugged", "status": "completed", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:52:34.333158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-8c6d388f-4dc9-4a08-bef5-4376196cd5e5 req-9b5fa099-d898-4106-85c1-a1dadb1ad293 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:34.333601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-8c6d388f-4dc9-4a08-bef5-4376196cd5e5 req-9b5fa099-d898-4106-85c1-a1dadb1ad293 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:34.347370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-8c6d388f-4dc9-4a08-bef5-4376196cd5e5 req-9b5fa099-d898-4106-85c1-a1dadb1ad293 service nova] Creating event network-vif-plugged:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 09:52:34.350112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:34.351402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:34.353016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-8c6d388f-4dc9-4a08-bef5-4376196cd5e5 req-9b5fa099-d898-4106-85c1-a1dadb1ad293 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034607 May 09 09:52:34.353959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 319/631] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:52:34.359540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:34.359995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:34.360794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:34.361356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:34.499534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:34.508111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:34.509647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:34.510808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51afba2e-f3aa-4d7e-b102-daaeccc372a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164713 May 09 09:52:34.511338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 313/632] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:34.687958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:34.688693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:34.696469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:34.696946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:34.697749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:34.698174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:34.766758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:34.774551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf89eed1-1a8d-4f3f-a875-f14a2b0e7701 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1271 microversion: 2.1 time: 0.090958 May 09 09:52:34.775123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 320/633] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:35.529516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:35.530350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:35.538291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:35.538291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:35.539183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:35.539621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:35.678164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:35.686687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:35.688183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:35.689389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ea844aa-c6ff-47a8-8147-4a4a9f3f5e6c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.164184 May 09 09:52:35.689960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 314/634] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:35.791758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:35.792638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:35.799557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:35.800042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:35.800992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:35.801412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:35.874314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:35.882092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6899638c-43a2-433f-8304-903cdb00e0d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1277 microversion: 2.1 time: 0.094439 May 09 09:52:35.882678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 321/635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:35 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1277 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:36.708839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:36.709483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:36.716707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:36.717163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:36.717914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:36.718374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:36.850186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:36.859907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:36.861453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:36.862643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73fea446-090e-4106-9509-830c53fb66e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.157905 May 09 09:52:36.863205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 315/636] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:36.900983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:36.901766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:36.908415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:36.908951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:36.909728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:36.910161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:37.105811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:37.114004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b49d2529-6cfd-4b4d-95c0-1e3b0ff16a9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.217134 May 09 09:52:37.114591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 322/637] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:36 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:37.175029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-2c442dee-7a2d-4820-bd65-b5b678d30e57 req-70526f0c-384e-4e62-b952-c81ab33b6215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7944fa2-ab61-4f7b-b2b1-799f6cd80268", "tag": "c89f62f3-cda6-4e2d-b4db-72ba5e09d0b8"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:52:37.184131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-2c442dee-7a2d-4820-bd65-b5b678d30e57 req-70526f0c-384e-4e62-b952-c81ab33b6215 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:37.184646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-2c442dee-7a2d-4820-bd65-b5b678d30e57 req-70526f0c-384e-4e62-b952-c81ab33b6215 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:37.197745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-2c442dee-7a2d-4820-bd65-b5b678d30e57 req-70526f0c-384e-4e62-b952-c81ab33b6215 service nova] Creating event network-changed:c89f62f3-cda6-4e2d-b4db-72ba5e09d0b8 for instance b7944fa2-ab61-4f7b-b2b1-799f6cd80268 on hv-cinder-84108 May 09 09:52:37.202642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-2c442dee-7a2d-4820-bd65-b5b678d30e57 req-70526f0c-384e-4e62-b952-c81ab33b6215 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031553 May 09 09:52:37.203264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 316/638] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:52:37.883032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:37.883628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:37.890619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:37.891064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:37.891851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:37.892279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:38.023594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:38.032712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:38.034346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:38.035501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-438fb391-f332-4095-800d-65c8ec8240aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.156490 May 09 09:52:38.036057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 323/639] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:38.137931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:38.139175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:38.148107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:38.148552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:38.149362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:38.149794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:38.288374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:38.297643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1cd20618-d792-4076-8c57-f0726627e51d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.168084 May 09 09:52:38.298346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 317/640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:38 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:39.054925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:39.055540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:39.064696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:39.065369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:39.066553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:39.067063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:39.213371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:39.222840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:39.224342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:39.225618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9952b60d-48f2-430a-b4bc-146aeb8e41e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.174834 May 09 09:52:39.226196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 324/641] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:39.315569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:39.316181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:39.323458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:39.323904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:39.324732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:39.325169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:39.457193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:39.464884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-05a0574a-7ccd-4ab6-80a6-ac26445cdfd3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.153462 May 09 09:52:39.465432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 318/642] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:40.247302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:40.247919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:40.254898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:40.255351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:40.256126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:40.256562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:40.389999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:40.399067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:40.400569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:40.401818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7e22f5f-617a-4716-afd5-791d5b5953a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.158524 May 09 09:52:40.402382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 325/643] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:40.482944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:40.483518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:40.490477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:40.490932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:40.491682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:40.492157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:40.628749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:40.638050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2407089-a1e4-43d1-b450-1d1b31423f5e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.159018 May 09 09:52:40.638693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 319/644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:40 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:41.420971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:41.421602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:41.428505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:41.428970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:41.429741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:41.430166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:41.567578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:41.576505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:41.578055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:41.579251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6d5be3d-aa36-46e4-a151-5cd511b289d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1809 microversion: 2.20 time: 0.162291 May 09 09:52:41.579816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 326/645] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:41.659370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:41.659982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:41.666916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:41.667360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:41.668137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:41.668561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:41.802155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:41.809903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9082471d-0c48-4e9a-b9a1-a30daf7387cc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.156794 May 09 09:52:41.810481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 320/646] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:41 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:42.598544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:42.599144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:42.606355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:42.606802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:42.607586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:42.608050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:42.747639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:42.756432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:42.757950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:42.759093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1c8ed424-fc2e-4cf5-abe6-990352b67586 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1796 microversion: 2.20 time: 0.164649 May 09 09:52:42.759659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 327/647] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 09:52:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1796 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 09:52:42.827267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:42.827840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:42.834673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:42.835128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:42.835933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:42.836372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:42.977556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:42.985526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07daa83d-13d8-40e8-81a3-0f1a3d13b647 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.162118 May 09 09:52:42.986311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 321/648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:42 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:44.003032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:44.003582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:44.010535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:44.010980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:44.011753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:44.012179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:44.155221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:44.164655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49580fb1-0f34-4be0-ba22-5c0a7633c225 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.165600 May 09 09:52:44.165275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 328/649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:43 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:44.457892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-ebdbf98f-818c-4f39-84b3-bc951a8d3778 req-1454fd1d-5767-4263-a7cc-11ea475175f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944fa2-ab61-4f7b-b2b1-799f6cd80268", "name": "network-vif-plugged", "status": "completed", "tag": "c89f62f3-cda6-4e2d-b4db-72ba5e09d0b8"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:52:44.467975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ebdbf98f-818c-4f39-84b3-bc951a8d3778 req-1454fd1d-5767-4263-a7cc-11ea475175f3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:44.467975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-ebdbf98f-818c-4f39-84b3-bc951a8d3778 req-1454fd1d-5767-4263-a7cc-11ea475175f3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:44.480488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-ebdbf98f-818c-4f39-84b3-bc951a8d3778 req-1454fd1d-5767-4263-a7cc-11ea475175f3 service nova] Creating event network-vif-plugged:c89f62f3-cda6-4e2d-b4db-72ba5e09d0b8 for instance b7944fa2-ab61-4f7b-b2b1-799f6cd80268 on hv-cinder-84108 May 09 09:52:44.485744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-ebdbf98f-818c-4f39-84b3-bc951a8d3778 req-1454fd1d-5767-4263-a7cc-11ea475175f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031692 May 09 09:52:44.486668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 322/650] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:52:45.182654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:45.183243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:45.189683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:45.190129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:45.190920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:45.191351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:45.331561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:45.339017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-90cb27cb-530c-42f3-83f2-818862b3c8d4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.160371 May 09 09:52:45.339624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 329/651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:45 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:52:46.361407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:46.362535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:46.373079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:46.373836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:46.375098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:46.375806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:46.515722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:46.523651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e07466dd-90ce-4e8d-9dd4-450943ce704e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1319 microversion: 2.1 time: 0.170488 May 09 09:52:46.524231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 323/652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:47.544695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:52:47.545648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:47.554488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:47.554936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:47.555715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:47.556148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:47.693993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:52:47.701635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89dbc2ff-6967-4115-923d-f60c95ba8c46 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1508 microversion: 2.1 time: 0.163409 May 09 09:52:47.702203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 330/653] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:52:47 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:52:47.718250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c04f4883-b536-4341-9152-cbe004698fe8", "device": "/dev/sdb"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:52:47.719814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:52:47.726523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:47.727002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:47.727770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:52:47.728549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:52:47.995640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-94bfa52b-184e-46ef-ae73-55dd200f3b20 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "POST /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281214 May 09 09:52:47.996469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 324/654] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:52:47 2022] POST /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:53:00.110242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d939d91f-94b1-4238-b109-48ff177d865b"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:53:00.111655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:00.118473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:00.118910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:00.119668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:00.120092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:00.731659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ff22504-d0e7-4548-ac41-abd42e388cf8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750109 May 09 09:53:00.732549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 331/655] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 09:52:59 2022] POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:53:12.690049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:12.690762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:12.699478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:12.700037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:12.701079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:12.701618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:12.728183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 09:53:12.814182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-174c7ee5-828f-4fc9-a0dc-f3a712bd2a57 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 204 len: 0 microversion: 2.1 time: 0.129260 May 09 09:53:12.814774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 325/656] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 09:53:12 2022] DELETE /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 09:53:12.823495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:12.824264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:12.830986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:12.831429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:12.832222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:12.832647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:12.962386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:12.970374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49e454ef-ac0a-4893-b719-b8af01c6b3c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.151058 May 09 09:53:12.970945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 332/657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:12 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:13.989869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:13.990455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:13.998578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:13.999272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:14.000516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:14.001256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:14.140931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:14.152482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3463dc5-6c15-4722-9488-68a88f5eb96f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.166774 May 09 09:53:14.153399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 326/658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:13 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:15.176731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:15.177723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:15.188540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:15.189331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:15.190666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:15.191401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:15.338945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:15.346772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a41bdaab-304b-4973-a375-1ebf2f5693c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.176755 May 09 09:53:15.347373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 333/659] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:15 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:16.367232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:16.368353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:16.378751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:16.379202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:16.379978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:16.380414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:16.517335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:16.524854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dcde1e62-64b4-4d76-8224-d0cc004ff657 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.164256 May 09 09:53:16.525423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 327/660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:16 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:17.542432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:17.543042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:17.550164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:17.550598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:17.551357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:17.551783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:17.685696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:17.693464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ce53abe-2476-4fdf-b262-94f75d080e1c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.154887 May 09 09:53:17.694033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 334/661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:17 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:18.814213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:18.814977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:18.821388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:18.821841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:18.822630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:18.823071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:18.956856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:18.964836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5b8645da-685b-4588-bd1f-1438613fff45 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.257731 May 09 09:53:18.965345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 328/662] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:18 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:19.197902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:53:19.198502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 09:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 09:53:19.981966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:19.982630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:19.989623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:19.990074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:19.990848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:19.991283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:20.122490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:20.130139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d29eb01f-5439-4d25-ad42-73314813039b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.152158 May 09 09:53:20.130732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 335/663] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:19 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:21.151878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:21.154004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:21.165781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:21.166514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:21.167770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:21.168486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:21.298781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:21.306682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5fcb10a-99c8-4ea8-8840-8d99a4331a97 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.161661 May 09 09:53:21.307247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 329/664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:21 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:22.324246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:22.324897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:22.331765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:22.332213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:22.333049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:22.333483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:22.475519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:22.485713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-898b2545-e7c3-44c4-8fb6-2118af7535a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.165303 May 09 09:53:22.486674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 336/665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:22 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:23.503546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:23.504126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:23.510955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:23.511521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:23.512295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:23.512721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:23.649254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:23.657381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1434f4a0-e0cd-42eb-9fe8-cda7cec006ef tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.158172 May 09 09:53:23.657956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 330/666] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:23 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:24.674734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:24.675344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:24.682163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:24.682625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:24.683390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:24.683847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:24.815983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:24.827123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3a57b125-d70b-451a-a94e-8a274b8c3ba9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.156098 May 09 09:53:24.827849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 337/667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:24 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:25.847325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:25.847904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:25.855375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:25.855844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:25.856581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:25.857098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:26.007780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:26.015690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-08a615f5-0cc8-4cf9-8b41-5b182ea84442 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.174194 May 09 09:53:26.016265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 331/668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:25 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:27.036276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:27.037286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:27.048051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:27.048928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:27.049701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:27.050126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:27.191380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:27.199520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2a83058c-f143-4b8b-a507-1ca972b27183 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.169764 May 09 09:53:27.200071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 338/669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:27 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:28.221919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:28.222614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:28.230180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:28.230674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:28.231550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:28.232024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:28.371786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:28.379389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-43435fdc-60d8-4ab1-8e76-f25b7369c982 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.163627 May 09 09:53:28.379998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 332/670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:28 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:29.400641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:29.401854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:29.412393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:29.413231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:29.414555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:29.415274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:29.546481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:29.554407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a94b8d8d-8bcd-4438-b0b3-f155c236aa55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.160362 May 09 09:53:29.555435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 339/671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:29 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:30.571331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:30.571950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:30.578753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:30.579205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:30.579975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:30.580414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:30.718185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:30.730462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df0cf59e-c3e2-40df-9b84-931710bd6aa1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.162608 May 09 09:53:30.731125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 333/672] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:30 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:31.753181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:31.754184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:31.764961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:31.765700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:31.766956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:31.767626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:31.906517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:31.914052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d63674d3-e00b-4a51-9740-d2d463bddaaa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.167424 May 09 09:53:31.914692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 340/673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:31 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:32.931843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:32.932447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:32.939225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:32.939680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:32.940453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:32.940926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:33.078514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:33.089167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d2b1a2c-fad3-4975-a895-bedb501b25cb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.160841 May 09 09:53:33.089909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 334/674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:32 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:34.108645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:34.109260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:34.119014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:34.119583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:34.120851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:34.121533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:34.259003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:34.266343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19feecc9-d715-4972-a838-e8399459f498 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.162542 May 09 09:53:34.274073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 341/675] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:34 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:34.348266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:34.348806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:34.355080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:34.355542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:34.356309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:34.356786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:34.455872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lazy-loading 'services' on Instance uuid 3383afcd-c1f1-4a06-b1e3-3bd49e32744a {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:53:34.529688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dabed0bf-c6b4-4a6c-9410-0e8caf8268d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments/c71c8ec1-f2e6-4a5c-a9e1-8c8f74fbb324" status: 202 len: 0 microversion: 2.1 time: 0.292098 May 09 09:53:34.530431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 335/676] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:53:34 2022] DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments/c71c8ec1-f2e6-4a5c-a9e1-8c8f74fbb324 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 09:53:35.287153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:35.288197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:35.298702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:35.299143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:35.299897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:35.300322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:35.447810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:35.456199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-127dffe1-1e6e-4fcb-9e2c-1c36938dabd6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.175584 May 09 09:53:35.456810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 342/677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:35 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:35.801291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:53:35.802402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:35.809110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:35.809403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:35.810213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:35.810639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:35.889769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-801c6983-6918-4a54-ba11-be92ed29a16c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/action" status: 202 len: 0 microversion: 2.1 time: 0.092550 May 09 09:53:35.890516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 336/678] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:53:35 2022] POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:53:35.903092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:35.904041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:35.912102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:35.912560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:35.913362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:35.913794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:36.077030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:36.085785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63fe634b-96ce-4015-a32a-4ee38ee6c882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.189081 May 09 09:53:36.086355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 343/679] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:35 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:36.478459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:36.479661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:36.490496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:36.491265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:36.492568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:36.493348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:36.637406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:36.645553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d65250f7-3812-4ce7-a715-37d1fa38e38d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.174920 May 09 09:53:36.646153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 337/680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:36 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:37.104064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:37.104604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:37.111425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:37.111870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:37.112635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:37.113096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:37.256435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:37.266416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-563fca6c-4c14-471b-8c69-90226876fae6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.166658 May 09 09:53:37.267046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 344/681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:37.666602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:37.667716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:37.676490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:37.677026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:37.677790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:37.678216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:37.817561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:37.825614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d267b0b-26cc-4e1e-b9a9-2cb894f850c6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.165414 May 09 09:53:37.826203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 338/682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:37 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:38.287766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:38.288731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:38.299159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:38.299574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:38.300367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:38.300836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:38.445036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:38.453216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84af34b3-ea43-4ac9-8709-148de3d8b6b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.171847 May 09 09:53:38.453848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 345/683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:38 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:38.842683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:38.843291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:38.850940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:38.851700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:38.852476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:38.852944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:38.997732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:39.005384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff8406de-78b3-4f90-9cdd-0fdb4039fd6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.166537 May 09 09:53:39.005854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 339/684] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:38 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:39.474962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:39.476044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:39.492039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:39.492335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:39.495505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:39.495505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:39.638877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:39.647859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2667e6f1-76a2-494a-95c2-9496afa90e3a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.179323 May 09 09:53:39.648742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 346/685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:40.022137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:40.022761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:40.029227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:40.029674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:40.030437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:40.030867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:40.170338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:40.180246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02de7364-3f1b-40ff-9c0a-f3c0cc57e83e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.161632 May 09 09:53:40.181148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 340/686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:40 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:40.673378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:40.674194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:40.682956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:40.683599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:40.684712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:40.685313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:40.836997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:40.848583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-341fb51f-528d-4c27-ad3d-dea2da6c55f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.182146 May 09 09:53:40.849187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 347/687] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:41.198363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:41.198928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:41.205800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:41.206244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:41.207002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:41.207432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:41.359173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:41.367028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a11b8ec-8f79-4016-a526-9c6a254f1fc4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.172573 May 09 09:53:41.367595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 341/688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:41 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:41.871671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:41.872626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:41.881285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:41.881728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:41.882485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:41.882913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:42.027258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:42.040157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7fae549e-3d90-46a5-959d-c71e1bf0c6c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.175215 May 09 09:53:42.041097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 348/689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:42.393805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:42.394727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:42.404864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:42.405315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:42.406322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:42.406815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:42.545537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:42.557058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8ab900d-4824-4523-8a4a-f151ea155702 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.169785 May 09 09:53:42.557647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 342/690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:42 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:43.060286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:43.060881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:43.068117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:43.068586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:43.069435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:43.069896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:43.220552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:43.229321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e33a2ed0-7f44-4e16-adc4-2cf3e57fb61e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.172890 May 09 09:53:43.229820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 349/691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:43 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:43.577180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:43.578183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:43.585134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:43.585603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:43.586452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:43.586885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:43.729012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:43.736596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c84ac534-577f-478b-8c87-b6a22536cc81 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.165937 May 09 09:53:43.737188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 343/692] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:43 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:44.246192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:44.246816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:44.253853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:44.254294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:44.255145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:44.255590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:44.407343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:44.415740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f80c954-87dc-4f52-965f-dd874615f46f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.173240 May 09 09:53:44.416297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 350/693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:44.755596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:44.756288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:44.765140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:44.765746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:44.766809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:44.767386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:44.908747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:44.916889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4a21663-e9cd-47de-a6d1-b6ac9256c2e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.166777 May 09 09:53:44.917450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 344/694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:44 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:45.437723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:45.438771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:45.445735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:45.446181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:45.446953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:45.447392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:45.592327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:45.601490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-25ea7523-cd33-46a7-872f-49f39b55a7d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.170234 May 09 09:53:45.602069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 351/695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:45.935547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:45.936214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:45.942949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:45.943410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:45.944166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:45.944589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:46.075888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:46.083436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da9bc88d-932b-4a9c-8ccc-7eddef2e755f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.151770 May 09 09:53:46.083996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 345/696] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:45 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:46.619252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:46.619837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:46.626674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:46.627177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:46.627959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:46.628394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:46.781191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:46.789337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60704c6f-1332-41ff-a151-a53661023716 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.174060 May 09 09:53:46.789902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 352/697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:47.101536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:47.102205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:47.108920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:47.109385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:47.110136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:47.110580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:47.250874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:47.256604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cdac78c8-2c2b-4c4c-b932-699b4a3c2a80 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.159299 May 09 09:53:47.257208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 346/698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:47 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:47.807212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:47.807811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:47.814971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:47.815412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:47.816172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:47.816597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:47.956795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:47.964694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b719b3ef-eb26-4678-a238-c76e678fa7a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.161409 May 09 09:53:47.965273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 353/699] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:47 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:48.273622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:48.274230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:48.281138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:48.281609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:48.282468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:48.282898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:48.422453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:48.433447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b6de454-2ac6-4a32-9ec8-0ec099dfbd2d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.163544 May 09 09:53:48.434280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 347/700] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:48 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:48.986498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:48.987178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:48.994761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:48.995286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:48.996175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:48.996705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:49.140630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:49.148498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21513e85-5034-4b4e-b8e1-46c4f61aa6e5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.168581 May 09 09:53:49.149086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 354/701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:48 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:49.455464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:49.456108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:49.464636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:49.465209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:49.466110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:49.466614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:49.606237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:49.613879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4647c0bf-1e5b-42b6-9cb0-454c8feeaaf4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.164527 May 09 09:53:49.614443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 348/702] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:49 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:50.172545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:50.173221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:50.181647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:50.182091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:50.182855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:50.183288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:50.352170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:50.361135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-222fde14-de10-4b32-944f-7bcc70e3b627 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.194508 May 09 09:53:50.361695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 355/703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:50 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:50.630356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:50.630962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:50.637750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:50.638201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:50.638972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:50.639400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:50.779810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:50.787384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3491ac1e-121b-404f-966c-9e402141badd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.160911 May 09 09:53:50.787956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 349/704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:50 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:51.382407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:51.383422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:51.394177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:51.394909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:51.396323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:51.397150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:51.553404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:51.565409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-636eb364-44c0-4db7-9715-c072f18851dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.189764 May 09 09:53:51.565996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 356/705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:51.808958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:51.809945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:51.820355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:51.821144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:51.822464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:51.823189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:51.972457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:51.980775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f7ca8cbb-3a21-406e-bbb0-28ca867a4a11 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.178206 May 09 09:53:51.981347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 350/706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:51 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:52.582856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:52.583468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:52.590222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:52.590666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:52.591438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:52.591867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:52.737095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:52.745202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb5545fa-7efb-4eba-8009-4f5437206220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.166647 May 09 09:53:52.745828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 357/707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:52 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:53.001838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:53.002476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:53.010195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:53.010724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:53.011612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:53.012121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:53.151166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:53.159262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ba67d7f-7427-4d1e-ab9d-22a1578c3e75 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.163790 May 09 09:53:53.159834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 351/708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:52 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:53.762783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:53.763399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:53.771701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:53.772302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:53.773479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:53.774065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:53.922913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:53.931317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eef6a517-e4da-45f9-93ab-8a3dbac77f39 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.172567 May 09 09:53:53.931869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 358/709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:54.179654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:54.180619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:54.191474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:54.192250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:54.193605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:54.194315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:54.346043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:54.353791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33072c86-4841-467f-bd73-9f9da920cc40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.180724 May 09 09:53:54.354394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 352/710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:54 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:54.955036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:54.955620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:54.963068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:54.963558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:54.964354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:54.964841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:55.112379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:55.120480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c04d15d-0bac-43e1-9f1e-91851ed94545 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.171158 May 09 09:53:55.121088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 359/711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:55.374867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:55.375720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:55.382856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:55.383333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:55.384145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:55.384602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:55.528625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:55.538486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2e496d4-bc78-41d1-ae26-4ba457b987c8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.170231 May 09 09:53:55.539104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 353/712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:55 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:56.139466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:56.140103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:56.150633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:56.151249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:56.152406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:56.153189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:56.310140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:56.322811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-679c67b5-0176-4e69-9db5-12f4126b1b9c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.188015 May 09 09:53:56.323747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 360/713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:56.557837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:56.558480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:56.565853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:56.566317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:56.567074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:56.567500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:56.697785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:56.705189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac38b61f-dd06-428d-b31a-436b70c1b307 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.151727 May 09 09:53:56.705754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 354/714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:56 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:57.401876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:57.402844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:57.411118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:57.411568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:57.412334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:57.412801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:57.570213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:57.578680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b6aae05-f61d-45bf-9902-2c59dde684e4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.183515 May 09 09:53:57.579252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 361/715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:57 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:57.726084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:57.726678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:57.735949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:57.736401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:57.737222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:57.737645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:57.866512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:57.874550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e6abbb6-fd42-475e-ba53-0573969370d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.155273 May 09 09:53:57.875141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 355/716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:57 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:58.595663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:58.596365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:58.603484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:58.603923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:58.604709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:58.605139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:58.748725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:58.757444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41c0c4da-ce7d-4580-a71e-5d46446a29a9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.165704 May 09 09:53:58.758004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 362/717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:58 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:58.895485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:58.896065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:58.902617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:58.903065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:58.903821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:58.904250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:59.055741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:59.063678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-944809b7-1a2f-41da-83e3-98e44141e4dd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.172096 May 09 09:53:59.064256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 356/718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:58 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:53:59.778778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:53:59.779760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:53:59.787257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:59.787698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:59.788453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:53:59.788919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:53:59.942932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:53:59.951646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c4aacbf-cc8f-4420-a960-39e7ff0a260e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.179286 May 09 09:53:59.952234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 363/719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:53:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:00.084506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:00.085598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:00.097392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:00.098189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:00.099449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:00.100172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:00.235233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:00.243071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8442198-cb87-4538-bd85-3c249d85fe47 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.165055 May 09 09:54:00.243643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 357/720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:00 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:00.968915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:00.969476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:00.976457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:00.976936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:00.977704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:00.978175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:01.133490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:01.146273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd492791-84e1-420d-ab35-b8aee4456c53 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.181006 May 09 09:54:01.147049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 364/721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:00 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:01.263983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:01.264896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:01.275584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:01.276294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:01.277692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:01.278446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:01.423373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:01.431220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f94ada0-afe0-400a-949a-325141b33d38 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.173752 May 09 09:54:01.431789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 358/722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:01 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:02.167202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:02.167844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:02.174559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.174997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.175752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.176178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.318978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:02.330013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43cd8b8d-7e03-44bf-a2e9-7405a959d734 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.167378 May 09 09:54:02.330611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 365/723] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:02.451963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:02.453170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:02.460238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.460700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.461548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.462005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.562448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:02.562941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:02.569070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.569512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.570277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.570702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.602050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42eaeb1f-d942-4332-8f1e-1b8e2cb91205 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments/f6bd883b-a2da-4446-91ac-a1cccde89d18" status: 200 len: 194 microversion: 2.20 time: 0.043657 May 09 09:54:02.602954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 366/724] 10.222.0.26 () {60 vars in 1453 bytes} [Mon May 9 09:54:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments/f6bd883b-a2da-4446-91ac-a1cccde89d18 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:02.605005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:02.613256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e72ab9a-981c-47b9-84bf-3f525e3f26ab tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.167594 May 09 09:54:02.613982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 359/725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:02 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:02.666846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:02.667518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:02.674479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.674951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.675704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.676137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.805320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lazy-loading 'services' on Instance uuid 2129ee65-9b99-4722-9747-26e9e1419653 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:54:02.920744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b89cf2fb-dda9-47d1-8eb3-23952fad5b29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments/f6bd883b-a2da-4446-91ac-a1cccde89d18" status: 202 len: 0 microversion: 2.20 time: 0.258204 May 09 09:54:02.921334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 367/726] 10.222.0.26 () {60 vars in 1456 bytes} [Mon May 9 09:54:02 2022] DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments/f6bd883b-a2da-4446-91ac-a1cccde89d18 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 09:54:02.930133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:02.931051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:02.937072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.937509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.938264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:02.938685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:02.967024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f2e80d4-1a03-4d0f-8971-43993bdc814b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040944 May 09 09:54:02.967636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 360/727] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:03.348339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:03.349117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:03.356042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.356488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.357313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.357744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.359861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:54:03.360839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:03.366893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.367372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.368126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.368558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.392403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'flavor' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:54:03.498115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:03.506022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf10c1e9-be7f-4dc1-abaa-52769b2093ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1749 microversion: 2.1 time: 0.162446 May 09 09:54:03.506612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 368/728] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:03.518612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93923a73-4faf-4d14-9a54-3d7f8b5cf4ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/action" status: 200 len: 32 microversion: 2.1 time: 0.162621 May 09 09:54:03.519278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 361/729] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:54:03 2022] POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 09 09:54:03.528113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:03.528740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:03.535447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.535916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.536717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.537124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.631155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:03.631857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:03.638520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.639093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.639877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.640359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:03.668164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:03.676563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64634a33-478f-426d-bc4c-3c363e4d3d12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152158 May 09 09:54:03.677179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 369/730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:03.786890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:03.805657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9343d797-b6b9-4bbd-b829-640906eab6ca tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.177120 May 09 09:54:03.816270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 362/731] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:03 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:03.981284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:03.982327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:03.993933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:03.994430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.002082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.002537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.032379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81c6739d-2669-430b-ba91-40edcfcbee11 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056796 May 09 09:54:04.032966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 370/732] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:04.524960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:04.525680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:04.532127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.532585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.533426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.533859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.694243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:04.694858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:04.701554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.702000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.702897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.703374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.842406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:04.851390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c8ce430-5e7d-42c0-ac2f-243b9bd73896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161193 May 09 09:54:04.851984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 371/733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:04.856689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:04.857295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:04.864272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.864762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:04.865623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:04.866064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:05.005312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:05.013014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df204d16-ba69-45ac-ab05-9eb2387e147b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1577 microversion: 2.1 time: 0.160025 May 09 09:54:05.013582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 372/734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:04 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:05.044005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:05.044988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:05.051408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:05.051865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:05.052636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:05.053100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:05.082726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d4ebfc0-898a-4bef-8f96-c59c593f2a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042783 May 09 09:54:05.086758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 373/735] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:54:05.090674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:05.105539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7af5717e-803d-44cf-886f-e5f69629519d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.584704 May 09 09:54:05.106163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 363/736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:04 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:05.720450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-9804bf61-48b5-433d-bd79-0fd7a69fedd1 req-d51f39a6-d0fa-41ee-8bc5-c6e9c196eeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2554f24-99b6-4ba6-91e9-9ec6289fbda0", "name": "network-vif-deleted", "tag": "d72de17a-e8f0-4642-9de8-3696406e4a3f"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:54:05.730910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9804bf61-48b5-433d-bd79-0fd7a69fedd1 req-d51f39a6-d0fa-41ee-8bc5-c6e9c196eeaf service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:05.731419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9804bf61-48b5-433d-bd79-0fd7a69fedd1 req-d51f39a6-d0fa-41ee-8bc5-c6e9c196eeaf service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:05.743279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-9804bf61-48b5-433d-bd79-0fd7a69fedd1 req-d51f39a6-d0fa-41ee-8bc5-c6e9c196eeaf service nova] Creating event network-vif-deleted:d72de17a-e8f0-4642-9de8-3696406e4a3f for instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 on hv-cinder-84108 May 09 09:54:05.748559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-9804bf61-48b5-433d-bd79-0fd7a69fedd1 req-d51f39a6-d0fa-41ee-8bc5-c6e9c196eeaf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107322 May 09 09:54:05.749240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 374/737] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:54:05.869211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:05.870380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:05.877373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:05.878049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:05.878983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:05.879577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.022771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:06.034433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-190b243a-042c-4d05-bc82-ef591339b23e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169327 May 09 09:54:06.044348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:06.044348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:06.046683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 364/738] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:06.047467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:06.047911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.049452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:06.049894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.094059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:06.095051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:06.101648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:06.102366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.103317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:06.103905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.123619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:06.134481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d33286b9-8a70-4e91-aed4-bf8203c5314f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.107739 May 09 09:54:06.135901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 375/739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:06.141147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:06.142066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:06.149063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:06.150571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.151566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:06.152459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:06.154401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b44dca2-756b-4452-8bc2-41f6c30a9322 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064387 May 09 09:54:06.159144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 365/740] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:54:06.296170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:06.305118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b51c7fb-16c0-4b79-9b47-ade935fcd88f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.167882 May 09 09:54:06.305921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 376/741] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:07.052004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:07.052598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:07.059494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.059940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.060696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.061235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.151526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:07.152093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:07.159524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.159973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.160801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.161319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.197607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:07.209739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-17ea302f-07ba-43a3-be4f-bc372b648943 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161638 May 09 09:54:07.210482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 366/742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:07.215672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:07.216887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:07.223569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.224154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.225121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.226106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.234356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:07.242762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10d94a44-8488-483a-a1cf-ffd0f699c5d8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.095210 May 09 09:54:07.243623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 377/743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:07 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:07.261497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f0f3c006-bdd7-4675-9e89-c39f7dce5d9e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049711 May 09 09:54:07.262370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 367/744] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:07.323077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:07.323587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:07.330113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.330566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.331340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:07.331807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:07.482723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:07.494773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cae0b4d5-caf5-4493-b1ef-288fb7b61153 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.175395 May 09 09:54:07.495511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 378/745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:07 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:08.227647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:08.228468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:08.236543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.237373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.238740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.239284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.259516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:08.260132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:08.267294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.267294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.268152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.268588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.328851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:08.336630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8cb61532-b9b6-4b85-8f81-b228cbe7ba3f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.081055 May 09 09:54:08.337407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 379/746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:08 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:08.341839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:08.342754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:08.348538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.349010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.349779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.350220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.380049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fab6f188-a789-4900-9ac0-95b4bc5d6707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041722 May 09 09:54:08.383893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 380/747] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:08.384705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:08.392620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aad249e2-c199-4f3c-9c94-9fae991274fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169201 May 09 09:54:08.393210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 368/748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:08.512443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:08.513080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:08.519718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.520157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.520964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:08.521403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:08.675657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:08.683605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-35826344-3b07-45eb-963a-2bf520025ed0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.175053 May 09 09:54:08.684179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 381/749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:09.353745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:09.354348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:09.360839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.361291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.362048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.362476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.391813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:09.392864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:09.399589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.400114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.400846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.401281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.425386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:09.432195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6f6a07e-8032-4382-91bf-c3d04f904cd3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044313 May 09 09:54:09.432795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 382/750] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:09.432969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a580ef1-add6-449b-97ed-92435ce3f059 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083409 May 09 09:54:09.440762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 369/751] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:09 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:09.440967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:09.440967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:09.443956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.444405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.445209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.445640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.576461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:09.584862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72ce112b-e358-465c-8b0f-448f38362d05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151123 May 09 09:54:09.585480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 383/752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:09.703797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:09.704610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:09.711193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.711640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.712402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:09.712886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:09.867807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:09.880974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7261745-ef75-46cb-a120-7f3c3c2cad3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.182892 May 09 09:54:09.881767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 370/753] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:10.446906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:10.447879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:10.450340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:10.450951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:10.454835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.455288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.456037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.456501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.457700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.458147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.458906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.459335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.485603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a0745ca-ca58-411a-830c-0603fe02810f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044222 May 09 09:54:10.486166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 384/754] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:10.520975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:10.528821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2fcde8c2-e96c-49bb-892f-998eba800f0b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082422 May 09 09:54:10.529358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 371/755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:10 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:10.603549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:10.604148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:10.611465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.611908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.612694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.613125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.752745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:10.761089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7567c4be-f8ba-407a-bfce-b294d214fb52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161773 May 09 09:54:10.761669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 385/756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:10.905213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:10.906254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:10.913570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.914063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:10.914904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:10.915380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.060903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:11.068972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4491419-f2c3-4951-a944-a790769771ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.170160 May 09 09:54:11.069549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 372/757] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:10 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:11.500973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:11.502389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:11.513025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:11.513758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.514999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:11.515605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.545580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:11.546299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1004c25b-fc94-42e8-a74f-1ef888b18c52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051457 May 09 09:54:11.546417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:11.546519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 386/758] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:11.552256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:11.552699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.553484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:11.553911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.618227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:11.626258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5092638d-70ef-4937-9690-cd048e9d5c32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084526 May 09 09:54:11.626845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 373/759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:11 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:11.781984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:11.782500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:11.789040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:11.789486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.790255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:11.790690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:11.919732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:11.928278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-25e51eb0-8a9a-444a-b6c4-36948e41637c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152324 May 09 09:54:11.928878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 387/760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:12.090695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:12.091701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:12.102001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.102001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.102801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.103269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.256888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:12.264794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5175df2f-1399-43b7-90b2-8fc4cc1bf909 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.180415 May 09 09:54:12.265407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 374/761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:12.562050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:12.562985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:12.569586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.570037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.570804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.571239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.599561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd0b6cb6-0ad5-47f7-afd3-f394eb37f677 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044357 May 09 09:54:12.600095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 388/762] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:12.643186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:12.643796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:12.650056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.650505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.651276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.651710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.716137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:12.724041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fb2bc908-123c-4e1f-9482-ae6eda2a69c3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085066 May 09 09:54:12.724606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 375/763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:12 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:12.949792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:12.950660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:12.957809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.958252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:12.959017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:12.959449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.084645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:13.092487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca6cea44-5eab-49f7-8f2b-07287cd6d7ba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.149312 May 09 09:54:13.093213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 389/764] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:13.283885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:13.284506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:13.290901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:13.291351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.292116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:13.292549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.443498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:13.455077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ecf6a00-c066-47d2-8cc4-1f93eb71f9ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.175861 May 09 09:54:13.455651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 376/765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:13.612835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:13.613758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:13.619967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:13.620446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.621242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:13.621668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.650635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df431d6c-2e3a-4608-9a23-9a749df1e026 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042350 May 09 09:54:13.651184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 390/766] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:13.742034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:13.742603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:13.749616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:13.750069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.750835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:13.751273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:13.824690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:13.832626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6375769e-a127-4d97-b393-11a659981cfa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.094573 May 09 09:54:13.833216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 377/767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:13 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:14.115014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:14.115880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:14.129759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.130213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.134109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.134566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.281651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:14.289949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01134c11-32db-4e52-b75f-b212c13cbf55 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.181626 May 09 09:54:14.290523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 391/768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:14.472747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:14.473327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:14.479900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.480345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.481150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.481587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.638836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:14.646826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1c97986-17a5-429b-b55f-07c98d68ddd3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.178018 May 09 09:54:14.647369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 378/769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:14.665401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:14.666818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:14.676116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.676895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.678063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.678724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.712648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-802f0538-cd68-46ea-b57c-1680456a3d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053765 May 09 09:54:14.713154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 392/770] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:14.851331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:14.852157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:14.860889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.861493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.862514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:14.863081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:14.928713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:14.936638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d514032f-4177-4893-8a84-34a5486a4a01 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.090840 May 09 09:54:14.937349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 379/771] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:14 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:15.312757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:15.313362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:15.319829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.320275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.321073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.321507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.458411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:15.468637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14aa3af8-60ea-49be-a073-64d21b33eddd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161994 May 09 09:54:15.469218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 393/772] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:15.668728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:15.669780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:15.677003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.677453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.678219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.678651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.723578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:15.724486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:15.731217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.731638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.732474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.732934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.762599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-be301d84-2147-481a-a915-6064e4ca6744 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042919 May 09 09:54:15.763561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 394/773] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:15.828281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:15.836233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2164fdc0-0b0f-476e-804c-fe2b54702417 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.173975 May 09 09:54:15.836790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 380/774] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:15.953905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:15.954419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:15.961058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.961505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:15.962274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:15.962708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:16.026563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:16.034595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-48a15a51-4751-4bd1-bd6d-3cffbbf6387e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084795 May 09 09:54:16.035142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 395/775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:15 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:16.486369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:16.486995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:16.493727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:16.494174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:16.494937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:16.495419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:16.627105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:16.635117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa21ff31-4931-4620-813c-101c319a9663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152719 May 09 09:54:16.635686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 381/776] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:16.775517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:16.776367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:16.783648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:16.784094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:16.784900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:16.785314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:16.814788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ab195d0-d1a9-438a-8278-3557812733b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043573 May 09 09:54:16.815328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 396/777] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:16.859260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:16.859947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:16.866369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:16.866814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:16.867617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:16.868053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.008685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:17.016736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f137d5e1-72ea-4b35-adb5-c444e909bced tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.161433 May 09 09:54:17.017308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 382/778] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:16 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:17.050839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:17.051436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:17.057647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:17.058080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.058842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:17.059267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.120824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:17.129007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3a9b1af-3b5d-4840-81d9-8745c618cbd7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082063 May 09 09:54:17.129589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 397/779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:17 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:17.652927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:17.653548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:17.660440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:17.660917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.661689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:17.662125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.797010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:17.809807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ab1c21e-1884-42ad-98b6-19093f7fc4dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160584 May 09 09:54:17.810728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 383/780] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:17.830621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:17.831972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:17.842396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:17.843085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.843846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:17.844273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:17.873436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5262ef05-1a2c-4b38-a90b-09ff85df0d4c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049535 May 09 09:54:17.873970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 398/781] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:18.038149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:18.039160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:18.048199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.048696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.049479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.049917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.144836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:18.145449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:18.151623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.152076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.152887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.153324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.191863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:18.200147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f319f95e-1347-4a22-a0ca-f9eb57af6b89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.168461 May 09 09:54:18.200838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 384/782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:18 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:18.213398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:18.221012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-67862bbf-45aa-4ea8-8cab-caf7e6865203 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.080048 May 09 09:54:18.221612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 399/783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:18 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:18.835966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:18.836926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:18.847807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.848543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.849863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.850912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.887345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:18.888272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:18.894955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.895413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.896230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:18.896684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:18.927118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c36d1af6-3820-4800-b908-4327cb51fcc4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043707 May 09 09:54:18.927735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 400/784] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:18.990167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:18.998500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d2dd59e-ffd7-4456-a904-95652c1a23ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169104 May 09 09:54:18.999038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 385/785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:19.220800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:19.221429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:19.229230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:19.229751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:19.230674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:19.231180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:19.239188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:19.239907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:19.247237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:19.247980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:19.249355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:19.249626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:19.315475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:19.323964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd3cd8c9-e9a9-4435-8558-1d1495aac5fa tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.089278 May 09 09:54:19.325052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 386/786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:19 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:19.380789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:19.392839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7072c88a-2b39-4cfc-bedd-e26dec83fce0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.177356 May 09 09:54:19.393682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 401/787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:19.942455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:19.944035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:19.954975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:19.955740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:19.957105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:19.957840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:19.991611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ed8f2c10-3123-4ede-96fa-0ba956b95c88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056176 May 09 09:54:19.992163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 387/788] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:20.018102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:20.019051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:20.028752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:20.029502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:20.030529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:20.030963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:20.183852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:20.196107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cd6456af-6c4e-4953-bb8f-9486c1b6c44c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.183728 May 09 09:54:20.197026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 402/789] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:20.342511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:20.343159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:20.353507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:20.354101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:20.355247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:20.355901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:20.415100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:20.415776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:20.417216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:20.422209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:20.422662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:20.423440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:20.423849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:20.424641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33edc8d9-a587-4aa9-8322-67b7e07200e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087867 May 09 09:54:20.425269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 388/790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:20 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:20.565377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:20.574018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f6d8c2fc-9753-4242-95d0-ef7b30b25c80 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.162839 May 09 09:54:20.574615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 403/791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:21.009684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:21.011463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:21.019469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.019919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.020702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.021164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.051069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cef25f98-94a6-414b-b0d5-eaa173bb6463 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048354 May 09 09:54:21.051629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 389/792] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:21.219597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:21.220437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:21.231509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.232257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.233638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.234077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.365894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:21.373835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-270cd5ae-60f1-4d2a-afe9-53b16027ac9f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161029 May 09 09:54:21.374434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 404/793] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:21.444600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:21.445654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:21.455909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.456657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.457970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.458706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.521973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:21.529826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b716053b-2d8f-4b9b-b865-50c7507d02c5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091869 May 09 09:54:21.530491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 390/794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:21 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:21.591598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:21.592212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:21.598899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.599356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.600438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:21.600909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:21.757681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:21.767257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c424d70-6bb8-4a52-a6e0-60ee59c2e36a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.179734 May 09 09:54:21.767836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 405/795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:22.064765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:22.065692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:22.072515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.072995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.073762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.074201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.103850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e446e97-eca4-4096-aa9d-070e34bd9a5f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044177 May 09 09:54:22.104406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 391/796] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:22.395491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:22.396352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:22.406570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.407010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.407773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.408197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.544184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:22.547060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:22.547677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:22.552636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb56d8aa-1d36-499e-b497-23bec92b093b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163903 May 09 09:54:22.553272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 406/797] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:22.554065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.554520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.555301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.555741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.619368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:22.627787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7d3dfd9-247c-4623-b502-18574c4b5b6a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084770 May 09 09:54:22.628334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 392/798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:22 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:22.788655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:22.789789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:22.798844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.799376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.800281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:22.800747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:22.952307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:22.960874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6f18897e-6112-4791-bfcc-3e8559e5f1b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.178737 May 09 09:54:22.961454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 407/799] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:22 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:23.117296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:23.118122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:23.125160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.125610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.126392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.126838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.156845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-261f1d7e-7c76-461b-a54b-bf1ec0924090 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043774 May 09 09:54:23.157783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 393/800] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:23.570806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:23.571603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:23.577854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.578297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.579051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.579478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.644637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:23.645273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:23.651552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.651999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.652804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.653240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.708784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:23.714388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:23.716957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09eecce2-9735-457d-9431-31edf3f93a87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150545 May 09 09:54:23.717702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 408/801] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:23.722336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70497901-3f05-4ff5-8f6a-c1b4ab3d1216 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.081515 May 09 09:54:23.722894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 394/802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:23 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:23.982950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:23.983687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:23.990446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.990918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:23.991718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:23.992236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.169785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:24.170912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:24.178013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:24.178474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.179266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:24.179703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.210799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-590290f2-c382-4eff-a827-a8f4d0d906fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045004 May 09 09:54:24.211417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 395/803] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:24.374004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:24.381935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-32efb8b2-6299-4940-839b-c56fcc6cef6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.405617 May 09 09:54:24.382511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 409/804] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:23 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:24.736714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:24.737347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:24.739579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:24.740186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:24.743809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:24.744242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.745044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:24.745477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.746723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:24.747159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.747916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:24.748341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:24.809861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:24.818223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4da9891d-d212-49f3-8a4e-085166c55f7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082342 May 09 09:54:24.818723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 410/805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:24 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:24.874407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:24.882393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-24e82b60-e08e-411a-88b9-96d39c7d7b2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150776 May 09 09:54:24.882962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 396/806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:25.227747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:25.229193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:25.239420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.240150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.241470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.242201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.273882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3607fd4f-59db-434f-b6b2-b9ce66971c2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053426 May 09 09:54:25.274476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 411/807] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:25.400032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:25.400630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:25.407569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.408020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.408839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.409283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.561565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:25.574417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-76633f7d-8933-439e-918a-dda9b0c64c68 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.178007 May 09 09:54:25.575326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 397/808] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:25.835100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:25.835715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:25.842194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.842756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.843516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.843943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.899891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:25.900499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:25.906856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.907299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.908061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:25.908487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:25.914289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:25.922023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e3d70d0b-8d0e-49c8-98c6-78424149b03d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.090855 May 09 09:54:25.922597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 412/809] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:25 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:26.056546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:26.065167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c0565fb-3ec2-46f1-baef-b7dfa64e83f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169136 May 09 09:54:26.065728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 398/810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:26.291880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:26.293501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:26.302420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:26.302997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:26.304066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:26.304636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:26.340903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c4401b0-7155-435b-89c5-83fc732736aa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055730 May 09 09:54:26.341451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 413/811] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:26.591806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:26.592518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:26.599505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:26.600279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:26.601088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:26.601521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:26.744042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:26.752936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e1edb8c-6af6-49a9-9a87-414b9d510927 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.165151 May 09 09:54:26.753553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 399/812] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:26.939507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:26.940080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:26.947102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:26.947635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:26.948460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:26.948928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.013764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:27.021708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-650fde98-2cb5-4216-8525-9036bfa38c7b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086428 May 09 09:54:27.022279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 414/813] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:26 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:27.085077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:27.086131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:27.096387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:27.097179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.098480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:27.099187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.244353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:27.252697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff3f0a3a-7d50-443c-9145-b387ecafb4fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174114 May 09 09:54:27.253315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 400/814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:27.353528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:27.354493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:27.361894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:27.362517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.363828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:27.364545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.396847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7790e90d-706c-4090-9d58-4c9907ee243a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047872 May 09 09:54:27.397400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 415/815] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:27.774270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:27.775271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:27.786045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:27.786773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.788050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:27.788785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:27.963861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:27.975829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9777374-564b-49cc-934d-1e9927d9b789 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.207745 May 09 09:54:27.976606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 401/816] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:28.038627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:28.039233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:28.046000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:28.046450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:28.047215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:28.047648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:28.115358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:28.126342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37b25323-9aba-4303-88da-6be6b60b603a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091547 May 09 09:54:28.126910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 416/817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:28 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:28.269666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:28.270214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:28.277197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:28.277647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:28.278409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:28.278835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:28.408926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:28.409845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:28.416010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:28.416453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:28.417255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:28.417681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:28.425376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:28.433261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1faced7e-e132-424e-b32c-5aa61ee0ccb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167649 May 09 09:54:28.434143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 402/818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:28.450321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d69e2da-1795-4c96-af71-d15b24c2c840 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045177 May 09 09:54:28.451058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 417/819] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:28.995797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:28.996391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:29.003831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.004280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.005153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.005592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.142995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:29.143614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:29.148470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:29.150206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.150655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.151425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.151860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.156717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1dbb8df2-7b06-4067-b15b-bde2d1778ca3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.164998 May 09 09:54:29.157387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 403/820] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:28 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:29.213690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:29.222348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-762aafe1-a365-4d38-86ac-2f0169140520 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083201 May 09 09:54:29.222952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 418/821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:29 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:29.453459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:29.454175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:29.461413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.461975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.462782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:29.462952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.463425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.463805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:29.470640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.471142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.471971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:29.472470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:29.503119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb8cd815-b4de-4fd9-9200-11e533098ded tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044501 May 09 09:54:29.503703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 419/822] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:29.596540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:29.609500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f6fd7e26-4ea4-4a98-85e9-e6fa0428588f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161244 May 09 09:54:29.610329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 404/823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:30.178179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:30.179108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:30.189987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.190733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.192004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.192733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.239322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:30.240028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:30.246403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.246853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.247628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.248085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.313564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:30.321109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6c40aae-a321-405b-890d-065c41cd9db8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085574 May 09 09:54:30.321676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 405/824] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:30 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:30.347389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:30.355721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-623dd51b-b494-4d8e-b003-2b0e5a5e2058 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1754 microversion: 2.1 time: 0.184016 May 09 09:54:30.356277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 420/825] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:30 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:30.519652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:30.521163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:30.530911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.531352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.532123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.532556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.562093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09d4e2f9-6f57-4ede-9a21-b88343990391 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049337 May 09 09:54:30.562663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 406/826] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:30.636141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:30.637181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:30.647185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.647966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.649243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:30.649978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:30.785732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:30.794062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54d9f1c9-78cf-4fb3-92ab-28cde2cbd4e4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164290 May 09 09:54:30.794634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 421/827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:31.339964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:31.340894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:31.348066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.348515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.349322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.350066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.378375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:31.378980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:31.385770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.386210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.386970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.387397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.414008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:31.422804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4578e24c-2213-4172-b847-4595fd69c5b5 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088145 May 09 09:54:31.423387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 407/828] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:31 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:31.539610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:31.547978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b078129a-bfee-418f-ab3a-380d9d90e928 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1757 microversion: 2.1 time: 0.173359 May 09 09:54:31.548550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 422/829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:31 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:31.574225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:31.575142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:31.581734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.582192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.582963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.583405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.614033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ca36188-3bc2-43c5-a318-7ce1b9239745 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044013 May 09 09:54:31.614587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 408/830] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:31.813835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:31.814504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:31.821231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.821697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.822502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:31.822961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:31.965128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:31.974422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1658c438-fa53-4303-a56d-bd77e9309834 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165803 May 09 09:54:31.975315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 423/831] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:32.445039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:32.445978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:32.454888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:32.455330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:32.456100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:32.456566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:32.518166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:32.525701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2196f3f2-78c7-48d1-8fe8-6a5518744d48 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087049 May 09 09:54:32.526259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 409/832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:32 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:32.630510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:32.632136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:32.642809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:32.643557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:32.644898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:32.645625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:32.678267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0c51145-b217-459a-b868-d8b1c6f31ecd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054623 May 09 09:54:32.678824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 424/833] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:32.995646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:32.996587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:33.006658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:33.007374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:33.008596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:33.009322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:33.145583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:33.153979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-435ce044-aaea-4755-b96a-640bd66f33a2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164715 May 09 09:54:33.154548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 410/834] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:33.543134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:33.543832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:33.554049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:33.554727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:33.555781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:33.556221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:33.619102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:33.626832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3512d98e-8491-4c08-884d-6976794280d6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087712 May 09 09:54:33.627403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 425/835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:33 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:33.694544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:33.696211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:33.704932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:33.705385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:33.706167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:33.706610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:33.736369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f206618e-526c-4594-841a-8df8cf09e7b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048550 May 09 09:54:33.736967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 411/836] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:34.175218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:34.176196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:34.186660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:34.187117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:34.187893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:34.188333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:34.326074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:34.334774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2651f97a-fbaa-44ee-a0a7-c5455de0e994 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166138 May 09 09:54:34.335355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 426/837] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:34.647738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:34.648746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:34.659064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:34.659804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:34.661138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:34.661808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:34.737033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:34.746211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-06e1d018-f5a3-4fc8-bc2c-53c83cc6d7bf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.104877 May 09 09:54:34.746783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 412/838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:34 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:34.747651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:34.748634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:34.755233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:34.755681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:34.756455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:34.756923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:34.786373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a2f26d9-2587-4dc1-b5c5-d119b598b804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042673 May 09 09:54:34.786935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 427/839] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:35.355594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:35.356189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:35.363660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:35.364145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:35.364942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:35.365375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:35.509829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:35.521748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abf12957-a7f4-4e10-b100-a7eb148f5d8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172076 May 09 09:54:35.522504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 413/840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:35.763370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:35.763927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:35.771085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:35.771534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:35.772289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:35.772711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:35.798168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:35.799243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:35.805915 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:35.806389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:35.807138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:35.807574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:35.835816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:35.839741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7680a4b1-efc5-4d94-83f2-bb2bcfa7eb84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045625 May 09 09:54:35.840397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 414/841] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:35.843430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0c01db67-a30e-4fee-931e-07f1ae64abfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084090 May 09 09:54:35.844005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 428/842] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:35 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:36.541982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:36.542981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:36.553145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.553900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.555351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.555973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.691713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:36.703258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0efad96c-3f36-4c85-92cd-87cb7039686b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1716 microversion: 2.1 time: 0.167900 May 09 09:54:36.703836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 415/843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:36.763156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:36.763763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:36.770393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.770848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.771622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.772054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.852150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:36.854095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:36.859639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.860089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.860892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.861330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.890663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9be44102-fd8a-498d-b4a8-ed04f9a59b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042932 May 09 09:54:36.891216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 416/844] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:36.895719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:36.896348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:36.902285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.902735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.903499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:36.903932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:36.964873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:36.972401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-60ba99d8-614d-41a7-a691-5260e5e3b137 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.080272 May 09 09:54:36.973003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 417/845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:36 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:37.906453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:37.907486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:37.915801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:37.916422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:37.917460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:37.918048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:37.951441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21488615-24a7-4b13-aa46-39ee5189bb05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051311 May 09 09:54:37.952034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 418/846] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:37.990336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:37.990966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:37.997571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:37.998161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:37.998963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:37.999404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:38.060808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:38.068527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c2cb583-1ea2-4e68-b89f-a0c6eb74e4b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082093 May 09 09:54:38.069179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 419/847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:37 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:38.963808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:38.964643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:38.971589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:38.972045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:38.972877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:38.973310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:39.004443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-114c5c28-4d3a-498d-a0a6-e8fc8f4d988c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 May 09 09:54:39.005171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 420/848] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:39.085212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:39.085824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:39.092285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:39.092765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:39.093535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:39.093970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:39.164913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:39.172925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ff8f626c-8e79-4478-a18a-dcd36bd47c16 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091441 May 09 09:54:39.173491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 421/849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:39 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:40.022946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:40.024262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:40.035423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:40.036257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:40.037670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:40.038410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:40.070357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5612df7b-5c12-4f65-a7a0-2aa57e0ea893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054710 May 09 09:54:40.070908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 422/850] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:40.190536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:40.191208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:40.198333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:40.198833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:40.199676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:40.200156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:40.266636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:40.274228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a45c120-dedf-4d34-b158-0f41a5191247 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087962 May 09 09:54:40.274718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 423/851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:40 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:41.086884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:41.088375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:41.096531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:41.096990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:41.097792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:41.098212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:41.127021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2db59c01-f040-4e57-9c1c-f1ea4c906b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046947 May 09 09:54:41.127570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 424/852] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:41.294494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:41.295457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:41.303353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:41.303903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:41.304894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:41.305404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:41.372797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:41.380391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25712dd5-23b3-4fe4-bbd3-cd611188f193 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092108 May 09 09:54:41.380986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 425/853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:41 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:42.140849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:42.141764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:42.148878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:42.149324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:42.150086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:42.150518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:42.181415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a70fa073-fef9-4623-9004-a09063364f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045930 May 09 09:54:42.181989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 426/854] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:54:42.401126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:42.401850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:42.409196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:42.409651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:42.410424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:42.410864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:42.474755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:42.482635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b99da8d5-3c53-4558-a600-441d1cab6b77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088243 May 09 09:54:42.483202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 427/855] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:42 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:43.197559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:43.199048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:43.209366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:43.210114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:43.211382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:43.212162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:43.243991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1b8a9f28-2a21-42b3-b7e1-3b69bde04f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053234 May 09 09:54:43.244544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 428/856] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:43.501571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:43.502251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:43.510803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:43.511322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:43.512249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:43.512720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:43.579913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:43.587726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d39aa49-e928-44ee-8ea6-4efe3932d639 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091688 May 09 09:54:43.588277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 429/857] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:43 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:44.259751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:44.261288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:44.268581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:44.269063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:44.269833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:44.270262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:44.298850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c449fcfb-5c44-4290-b8e0-ae73a7a8e2eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046026 May 09 09:54:44.299403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 430/858] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:44.604686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:44.605364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:44.612889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:44.613389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:44.614268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:44.614816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:44.686032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:44.693832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-577999e6-c2e4-4cd2-9da6-fa606038c1bc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.093755 May 09 09:54:44.694399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 431/859] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:44 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:45.315399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:45.316410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:45.323651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:45.324123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:45.324993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:45.325452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:45.355919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-857fd96f-8c05-4a1e-b556-d9ad56b6ebcf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 May 09 09:54:45.356462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 432/860] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:45.714088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:45.714966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:45.725333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:45.726002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:45.727206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:45.727845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:45.805658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:45.816481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-951eb14a-ab74-4755-a6ae-2759917dbf94 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.108935 May 09 09:54:45.817152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 433/861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:45 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:46.371357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:46.372917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:46.380004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:46.380499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:46.381387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:46.381868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:46.412830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-053b37bd-b522-4d1d-b8fd-b6c4d825699e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048230 May 09 09:54:46.413374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 434/862] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:46.837520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:46.838408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:46.846152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:46.846608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:46.847369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:46.847805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:46.910715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:46.918298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ef301270-2b15-42e7-bcda-db93e9123c53 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087606 May 09 09:54:46.918867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 435/863] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:46 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:47.428244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:47.429754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:47.439635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:47.440371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:47.441730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:47.442436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:47.477840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-893582b3-a26e-40a5-b444-6db8714c371f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056157 May 09 09:54:47.478401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 436/864] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:47.939122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:47.940150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:47.950869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:47.951326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:47.952139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:47.952573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:48.024467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:48.035536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0217f730-0dd1-46a3-9578-5c2372d70f2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.102624 May 09 09:54:48.036326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 437/865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:47 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:48.494327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:48.496023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:48.503260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:48.503709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:48.504575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:48.505035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:48.534604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-94e9c77a-c1c9-48e4-a8d4-d8d2fd2f88da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046987 May 09 09:54:48.535152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 438/866] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:49.059351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:49.060310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:49.067131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:49.067575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:49.068337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:49.068827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:49.136542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:49.144191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e21e964-6969-409e-80d4-af78feb76cfc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091403 May 09 09:54:49.144808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 439/867] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:49 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:49.546800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:49.547709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:49.554173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:49.554618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:49.555381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:49.555809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:49.586418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25b68a44-6b7c-41cf-841f-88849eb3474a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043725 May 09 09:54:49.586982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 440/868] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:54:50.162784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:50.163589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:50.171631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:50.172074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:50.172883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:50.173318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:50.234030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:50.241688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-340fa12a-0dc2-4783-9d98-4c17ec8a87d7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083829 May 09 09:54:50.242255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 441/869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:50 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:50.599812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:50.600742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:50.608232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:50.608698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:50.609491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:50.609926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:50.643091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-049daa72-493b-4ef9-9aeb-4107548d705f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048092 May 09 09:54:50.643642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 442/870] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:54:51.262131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:51.263118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:51.269821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:51.270262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:51.270995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:51.271455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:51.345499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:51.354211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-89a70049-cc08-43d6-a5cb-5751998d50cf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.098688 May 09 09:54:51.354786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 443/871] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:51 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:51.661428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:51.662480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:51.670819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:51.671267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:51.672022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:51.672449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:51.702451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13d87b85-9864-4cf3-b8f0-e4f7263802b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047372 May 09 09:54:51.702994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 444/872] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:52.374990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:52.375974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:52.386868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:52.387613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:52.388931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:52.389697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:52.467169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:52.475235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-007a5861-b8de-4da1-a9e6-a3dcfdd6853d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.106832 May 09 09:54:52.475806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 445/873] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:52 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:52.718187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:52.719606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:52.730131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:52.730868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:52.732059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:52.732469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:52.761362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a08abb77-6b5b-461c-b7a1-fbe069c82986 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049991 May 09 09:54:52.761917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 446/874] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:53.494681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:53.495478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:53.505443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:53.506083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:53.507259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:53.507813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:53.572810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:53.580453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3a8cd50-6f67-4d04-9e96-d31c7d001fda tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092271 May 09 09:54:53.581070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 447/875] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:53 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:54:53.779603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:53.780469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:53.787033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:53.787487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:53.788280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:53.788710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:53.818132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c5617679-63a5-424f-ad09-9f932ec0ff2c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044222 May 09 09:54:53.818735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 448/876] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:54.597540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:54.603495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:54.605909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:54.606356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:54.607127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:54.607559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:54.668921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:54.677064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c1b58227-241a-402a-852a-2ef4e11c963b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083612 May 09 09:54:54.677631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 449/877] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:54 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:54.835249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:54.836620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:54.851367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:54.852449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:54.854279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:54.855410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:54.887395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3611477a-0cae-4cad-8e94-b874d00f7776 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058933 May 09 09:54:54.888018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 450/878] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:55.698058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:55.699098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:55.708151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:55.708874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:55.709747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:55.710235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:55.781722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:55.789730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cb46776-2a19-4d3e-bc9b-e81a18b084b0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.098340 May 09 09:54:55.790266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 451/879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:55 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:55.905349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:55.906452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:55.914881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:55.915490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:55.916718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:55.917738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:55.954053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bea225cb-2a2f-4fa2-a390-bfd4ead93a42 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055030 May 09 09:54:55.954608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 452/880] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:56.810588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:56.811271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:56.819033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:56.819438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:56.820298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:56.820897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:56.889704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:56.897914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-daeca86d-5ebd-4d39-93b1-46cf6faaec40 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.093785 May 09 09:54:56.898476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 453/881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:56 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:56.965937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:56.966886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:56.973653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:56.974416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:56.975182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:56.975617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:57.005863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb3e6167-bdaa-4390-9671-a8edf9d4a5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043802 May 09 09:54:57.006419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 454/882] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:57.918588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:57.919438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:57.926901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:57.927402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:57.928248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:57.928752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:58.002620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:58.010559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bd96e4b-24e3-49a6-8468-2f8539a525e2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.098624 May 09 09:54:58.011168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 455/883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:57 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:58.017525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:58.018428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:58.026866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:58.027592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:58.028710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:58.029333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:58.059661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a60b5bbf-992d-4d06-aeeb-e9892a88613a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045634 May 09 09:54:58.060218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 456/884] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:54:59.033142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:59.033813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:59.042136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:59.042998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:59.044393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:59.045099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:59.114172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:54:59.121780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4df0fac6-5d06-4be8-82f3-7198f3a2fe18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.096880 May 09 09:54:59.122415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 457/885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:54:59 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:54:59.126887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:54:59.127802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:54:59.133549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:59.133996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:59.134757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:54:59.135187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:54:59.163604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-71d56de4-b815-43a8-acdf-c3b7e8fdc82a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040203 May 09 09:54:59.164147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 458/886] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:54:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:00.140956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:00.141655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:00.148295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:00.148765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:00.149527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:00.149966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:00.222271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:00.233890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fb346dbf-68d2-4aa4-93a8-6cf197ee77b8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.097746 May 09 09:55:00.234467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 459/887] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:00 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:00.239025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:00.239934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:00.245644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:00.246105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:00.246862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:00.247297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:00.439340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-85c2c377-0e07-4375-bb1a-3d567eb4df2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.203751 May 09 09:55:00.439814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 460/888] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:01.255036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:01.256105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:01.266554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:01.267290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:01.268549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:01.269293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:01.351380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:01.359450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-17a19edf-5b2b-47c5-8270-b0aa6f0b2905 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.110893 May 09 09:55:01.359947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 461/889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:01 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:01.455606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:01.457122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:01.467128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:01.467878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:01.469197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:01.469931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:01.503322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e8c89644-51e4-4d30-afb6-b44c7591aa54 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054624 May 09 09:55:01.503867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 462/890] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:02.383782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:02.384928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:02.392694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:02.393155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:02.393931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:02.394364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:02.460453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:02.468363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d64031af-b873-44dd-977b-a77b8b3746e6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091119 May 09 09:55:02.468958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 463/891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:02 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:02.519053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:02.520559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:02.530669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:02.531443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:02.532762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:02.533466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:02.565899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-155c2aeb-f5ce-4a26-b7c8-4ddc4a169008 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053367 May 09 09:55:02.566441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 464/892] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:03.489593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:03.490713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:03.499643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:03.500099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:03.500906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:03.501328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:03.562281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:03.570854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-52dcba74-ecee-4c03-a772-96677957043d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087859 May 09 09:55:03.571735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 465/893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:03 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:03.577651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:03.578574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:03.584956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:03.585406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:03.586173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:03.586631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:03.615398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c91c92f-0059-4a89-bb47-48e956a89e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041752 May 09 09:55:03.615943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 466/894] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:04.587920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:04.588537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:04.595793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:04.596265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:04.597096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:04.597547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:04.664991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:04.673763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7a29b48-3ad6-40ea-89f8-42e5967e86fb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.090022 May 09 09:55:04.674291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 467/895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:04 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:04.678758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:04.679656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:04.685096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:04.685543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:04.686300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:04.686728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:04.714585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4304f828-3597-4791-b43b-fd01565e8193 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039273 May 09 09:55:04.715112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 468/896] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:05.694420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:05.695488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:05.706451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:05.707194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:05.708447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:05.709198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:05.781680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:05.793814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a4ab318e-79e0-4723-81fc-2b29142cb38f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.105425 May 09 09:55:05.794669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 469/897] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:05 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:05.799216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:05.800124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:05.807604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:05.808331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:05.809568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:05.810291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:05.843284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4659df87-c06f-4945-b4be-918a0cd67749 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047422 May 09 09:55:05.843755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 470/898] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:06.814910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:06.815982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:06.826526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:06.826976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:06.827736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:06.828165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:06.889278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:06.896971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15428994-abc1-4792-8614-9fd1f064db7f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088660 May 09 09:55:06.897627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 471/899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:06.902170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:06.903106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:06.910287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:06.910733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:06.911525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:06.911956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:06.941187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92edff30-6b0b-40cf-86d3-fa9949b6f9af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042595 May 09 09:55:06.941942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 472/900] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:07.917082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:07.918080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:07.928914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:07.929661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:07.930987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:07.931708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:07.993146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:08.001042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66f0b1f9-c3c9-4298-a51b-e014f91166a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.090518 May 09 09:55:08.001615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 473/901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:07 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:08.006133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:08.007120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:08.013239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:08.013685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:08.014449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:08.014879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:08.044066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2ee21c2-20d0-4671-80c9-8b1187dc53f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041468 May 09 09:55:08.044602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 474/902] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:09.021576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:09.022598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:09.033167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:09.033907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:09.035265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:09.035930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:09.105183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:09.113274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e4bdfd36-e8b3-4b96-80c0-fc92f265b1a1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.098217 May 09 09:55:09.114373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 475/903] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:09 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:09.118826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:09.119730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:09.126246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:09.126901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:09.128030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:09.128640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:09.160069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd2c5a19-7f58-48ce-94ef-608dfe780a0a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044753 May 09 09:55:09.160656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 476/904] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:10.135301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:10.136414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:10.147122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:10.147877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:10.149203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:10.149917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:10.215047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:10.222724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0fc6805a-c11b-420c-9e85-8ccd671295b3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.093925 May 09 09:55:10.223283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 477/905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:10 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:10.228353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:10.229323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:10.235330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:10.235779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:10.236550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:10.237008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:10.265478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65b46f3a-0c38-4dfd-a136-c24e222b1596 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040907 May 09 09:55:10.266015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 478/906] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:11.241967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:11.242858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:11.251540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:11.252130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:11.253203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:11.253777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:11.315289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:11.323089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e267d95-fb53-488e-a245-431b000ca5e7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086335 May 09 09:55:11.323649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 479/907] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:11 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:11.328696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:11.329611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:11.335602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:11.336039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:11.336913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:11.337346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:11.365516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-67d351d2-3496-43dc-95af-a973046d16fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040894 May 09 09:55:11.366043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 480/908] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:12.343450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:12.344606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:12.355572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:12.356311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:12.357626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:12.358340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:12.424238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:12.432031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d06646f-d37d-45a6-a317-7601f514be68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.095175 May 09 09:55:12.432683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 481/909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:12 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:12.437676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:12.438583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:12.445084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:12.445831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:12.446745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:12.447178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:12.477277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f0f686d-cb01-4c23-9bce-d0f5b1d3be21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043597 May 09 09:55:12.477794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 482/910] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:13.452945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:13.454303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:13.465948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:13.466512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:13.467474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:13.468158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:13.536391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:13.544268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-00994a50-22bf-4d4b-9261-f86de0782bc3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.096889 May 09 09:55:13.544862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 483/911] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:13 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:13.549444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:13.550347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:13.556717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:13.557192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:13.557978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:13.558458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:13.588268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d52092bc-3078-4fd2-bc25-4b9fbee79190 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042353 May 09 09:55:13.588932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 484/912] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:14.561934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:14.562541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:14.569402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:14.569855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:14.570621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:14.571057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:14.634307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:14.642294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19ae901c-3e16-4a3c-a9fe-edbeadfadffc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084498 May 09 09:55:14.642858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 485/913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:14 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:14.647385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:14.648324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:14.654136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:14.654586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:14.655349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:14.655785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:14.684807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-216b4c2c-7c6c-46fe-aed4-c30a5cfff1fd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040838 May 09 09:55:14.685272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 486/914] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:15.663186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:15.664345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:15.672621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:15.673102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:15.673864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:15.674297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:15.735429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:15.743682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9726d8f-c7f9-4ef9-a62a-96ceafb65afd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086998 May 09 09:55:15.744242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 487/915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:15 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:15.748951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:15.749849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:15.755493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:15.755932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:15.756692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:15.757142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:15.786178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0144cbe-1b59-473e-8f58-356a187121d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040829 May 09 09:55:15.786798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 488/916] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:16.761150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:16.762513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:16.770587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:16.771025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:16.771796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:16.772234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:16.836432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:16.844248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ae37c22-cbbd-4fbb-8ad1-7389df3f5019 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087374 May 09 09:55:16.844852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 489/917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:16 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:16.849709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:16.850614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:16.857013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:16.857574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:16.858344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:16.858772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:16.887538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-274e07cd-91bc-4023-b1f5-7d9772871cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041732 May 09 09:55:16.888096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 490/918] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:17.861660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:17.862320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:17.869156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:17.869608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:17.870373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:17.870893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:17.935654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:17.947547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3bfc86af-bd90-4a66-9d22-ed39899caf1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.089551 May 09 09:55:17.948270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 491/919] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:17 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:17.954633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:17.955760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:17.963367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:17.963816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:17.964946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:17.965388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:17.996521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2d07a318-5007-4a5d-bb36-a641d528bef5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046545 May 09 09:55:17.997101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 492/920] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:18.969144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:18.970315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:18.980848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:18.981309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:18.982085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:18.982561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:19.058746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:19.066443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c5e8032-096b-47e6-bfec-14a90945dc32 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.103945 May 09 09:55:19.067001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 493/921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:18 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:19.071554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:19.072466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:19.078242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:19.078700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:19.079504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:19.079885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:19.108777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8d84ad4-7539-4336-8944-654c8d9d93ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040766 May 09 09:55:19.109328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 494/922] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:20.087799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:20.088945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:20.095990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:20.096437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:20.097223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:20.097660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:20.157760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:20.165814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-235b05ef-c657-46c7-8201-840b0a9b12c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084552 May 09 09:55:20.166334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 495/923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:20 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:20.170897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:20.171809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:20.180652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:20.181603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:20.182845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:20.183465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:20.218674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ecc828a0-05ff-4a42-9ee7-d8a829718ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051334 May 09 09:55:20.219609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 496/924] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:21.184305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:21.185381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:21.195628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:21.196191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:21.197455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:21.198158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:21.260634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:21.268349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2a0fa9f-c7d7-4b6e-8afa-ed1d2303a4c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088265 May 09 09:55:21.268944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 497/925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:21 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:21.273537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:21.274438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:21.280396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:21.280887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:21.281694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:21.282119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:21.312450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-237006a7-2cd9-40bb-99bf-ff790ed5a338 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042495 May 09 09:55:21.313042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 498/926] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:22.288879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:22.290011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:22.301129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:22.301845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:22.303246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:22.303801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:22.370447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:22.378567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-406ea8e5-5ef3-4675-8454-f84790f0f458 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.096197 May 09 09:55:22.379134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 499/927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:22 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:22.383771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:22.384694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:22.391651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:22.392430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:22.393244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:22.393964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:22.433294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a715ea7c-226f-4798-b55a-617bd0a1d60d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052743 May 09 09:55:22.433860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 500/928] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:23.395289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:23.396020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:23.403131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:23.403576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:23.404340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:23.404801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:23.468582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:23.477806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f3e5742-92b1-4a4b-b502-2e7ee0e24ab4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086278 May 09 09:55:23.478646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 501/929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:23 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:23.483591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:23.484589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:23.490581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:23.491023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:23.491848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:23.492277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:23.520384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fee70b48-3ee4-4f94-95fc-647a3cb393a6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040712 May 09 09:55:23.520966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 502/930] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:24.498139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:24.498862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:24.505532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:24.505976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:24.506735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:24.507166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:24.570568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:24.580146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93cb7e9a-4d79-413f-b53e-3a4c2b3ecb25 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087447 May 09 09:55:24.580716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 503/931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:24 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:24.585379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:24.586305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:24.593463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:24.593894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:24.594767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:24.595213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:24.625446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02539466-e375-452d-a0de-43d8c2f8e68e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043691 May 09 09:55:24.625977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 504/932] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:25.599622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:25.600331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:25.608412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:25.608911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:25.609685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:25.610123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:25.677527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:25.685664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-744b8e95-3a5a-4624-bef0-bdcbc5f6c7b4 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092592 May 09 09:55:25.686229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 505/933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:25 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:55:25.690759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:25.691684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:25.697652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:25.698106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:25.698959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:25.699397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:25.728391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-17f82c6d-c21d-4108-b41b-f2e5a893ce40 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041192 May 09 09:55:25.729054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 506/934] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:26.703912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:26.704599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:26.711283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:26.711734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:26.712515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:26.712985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:26.783733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:26.792112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-36be65b4-7c74-4fd1-8b23-2fda007c1626 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092265 May 09 09:55:26.793068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 507/935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:26 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:26.797895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:26.798806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:26.807869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:26.808514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:26.809318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:26.809752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:26.840446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-64ebbbeb-e7d3-4fe4-a032-d9415fab0041 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 May 09 09:55:26.841038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 508/936] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:27.810636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:27.811321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:27.818239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:27.818621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:27.819398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:27.819833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:27.895360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:27.907776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2d7c51ca-34c1-43a6-b2ca-9a07f1d8ad18 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.100832 May 09 09:55:27.908736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 509/937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:27 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:27.915987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:27.917108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:27.923292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:27.923741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:27.924540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:27.925033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:27.954440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dadef38e-be12-4e9b-a995-1a81d5dee390 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044459 May 09 09:55:27.955021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 510/938] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:28.930437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:28.931201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:28.939408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:28.940004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:28.940826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:28.941290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:29.017989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:29.028458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-41186c91-6ed8-421c-902c-f8d1f00ed1c9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.103741 May 09 09:55:29.029058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 511/939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:28 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:29.033850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:29.034759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:29.040494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:29.040993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:29.041767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:29.042227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:29.075842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de3c2996-2b7b-4729-8aef-26a624499dd1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045731 May 09 09:55:29.076451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 512/940] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:30.048511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:30.049833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:30.060217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:30.060986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:30.062235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:30.063040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:30.140472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:30.148477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ce9d99ce-4447-45d5-9bc0-da0d6bb7d741 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.106233 May 09 09:55:30.149074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 513/941] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:30 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:30.153750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:30.154652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:30.160998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:30.161475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:30.162302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:30.162755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:30.192590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9bacbb98-a559-4fe9-8af1-b8b4a56b470e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042497 May 09 09:55:30.193147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 514/942] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:31.165699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:31.166430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:31.172939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:31.173383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:31.174145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:31.174573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:31.236603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:31.244408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d409ad0-6179-4401-8777-502d11e66f82 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082689 May 09 09:55:31.244992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 515/943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:31 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:55:31.249589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:31.250484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:31.256236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:31.256697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:31.257459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:31.257883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:31.287862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd7b6484-ae95-455d-b0af-92c12da22e3d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041022 May 09 09:55:31.287862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 516/944] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:32.264217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:32.264984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:32.271363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:32.271814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:32.272591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:32.273067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:32.344778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:32.356759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-01bd286a-9042-4fc6-b88b-73706bcc2ccf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.097281 May 09 09:55:32.357359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 517/945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:32 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:55:32.362774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:32.363857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:32.370475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:32.370923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:32.371690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:32.372121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:32.407114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2cadddf6-0e04-4458-92d1-e202e8db4ed4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048312 May 09 09:55:32.407932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 518/946] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:33.376732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:33.377761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:33.387107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:33.387635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:33.388554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:33.389204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:33.460397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:33.468416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e82a3a1-a94b-4880-8fd5-dffe6da5f821 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.098359 May 09 09:55:33.469014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 519/947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:33 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:55:33.473898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:33.474798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:33.480387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:33.480869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:33.481635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:33.482065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:33.511882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d588e9f-ea93-41fa-bf2a-f02a8afb0328 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041827 May 09 09:55:33.512477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 520/948] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:34.486390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:34.487135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:34.494116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:34.494562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:34.495376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:34.495794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:34.559039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:34.569978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2985a56-d0b3-4567-98c7-85716628a035 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087220 May 09 09:55:34.570735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 521/949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:34 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:34.575475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:34.576359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:34.582986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:34.583428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:34.584226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:34.584695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:34.614707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8de38119-6d90-451c-8b90-5c9a2d710330 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042958 May 09 09:55:34.615264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 522/950] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:35.587179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:35.587794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:35.594889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:35.595342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:35.596079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:35.596518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:35.672187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:35.680588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9df7ba7-7308-4aff-8048-dcffb94ed12f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.097341 May 09 09:55:35.681208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 523/951] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:35 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:55:35.685923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:35.687105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:35.693124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:35.693574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:35.694365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:35.694830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:35.723700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4db46930-068b-467a-854a-3a1b147d9bd9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041480 May 09 09:55:35.724221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 524/952] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:36.700548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:36.701252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:36.709066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:36.709544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:36.711205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:36.711205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:36.779401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:55:36.787341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0048dd73-21a9-42cd-8659-1b67e1e2598c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092220 May 09 09:55:36.787906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 525/953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:55:36 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:55:36.792501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:36.793427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:36.799201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:36.799654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:36.800479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:36.800969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:36.830728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75643061-1aff-4de4-8bd9-f0670a5d9473 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041721 May 09 09:55:36.831230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 526/954] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:55:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:55:36.835868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:55:36.836355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:55:36.842250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:36.842697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:36.843465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:55:36.843910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:55:40.368063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:55:40.368877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 09:55:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 09:55:45.001585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:55:45.002284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 09:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 09:55:51.876049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:55:51.876836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 09:55:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 09:56:04.434860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:56:04.436549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 09:56:04.438021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:56:04.438711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:56:04.439994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 409 to user: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:56:04.441065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-650cfdfb-fb27-4159-8aa1-36735f761d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 409 len: 152 microversion: 2.1 time: 87.678915 May 09 09:56:04.441065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 429/955] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:54:36 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 152 bytes in 87680 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 09:56:04.444336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:04.444977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:04.451247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.451699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.452439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.452918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.522376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:04.530413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc5cd810-665a-40ed-8f33-bd5d8362e96d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.090912 May 09 09:56:04.530960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 430/956] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:04 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:04.536275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.536839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:04.540923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 09:56:04.542870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 09:56:04.544381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:56:04.545154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued May 09 09:56:04.546504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 09:56:04.547517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.547517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.547517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.547517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.547810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 409 to user: Cannot 'detach_volume' instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 while it is in vm_state rescued {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:56:04.547892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-128b8eb8-0b0d-4d95-8996-707b279d5c51 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 409 len: 152 microversion: 2.1 time: 27.715142 May 09 09:56:04.549350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 527/957] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:55:36 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 152 bytes in 27717 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 09 09:56:04.578967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76daf46b-e9f0-4483-91f7-82e19c0472da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046553 May 09 09:56:04.579640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 431/958] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:04.584332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:56:04.584882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:04.590991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.591495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.592436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.592953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.607378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-479391809"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:56:04.607378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:04.613433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.613879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.614653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.615081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.664101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0109eade-b0d5-4969-af3b-cea119a181e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/action" status: 202 len: 0 microversion: 2.1 time: 0.083271 May 09 09:56:04.664771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 432/959] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:56:04 2022] POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:56:04.673127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:04.673826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:04.679908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.680349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.681285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:04.681722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:04.776901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.network.security_group_api [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Removing security group f2af6155-0421-4118-93b2-647d5ae15abd from port aae37ee9-ba7e-4ac4-84da-717f219440f4 May 09 09:56:04.811281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:04.819469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df5362fa-c449-43d0-9a5c-2f5d5c5bf8f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1724 microversion: 2.1 time: 0.150428 May 09 09:56:04.820030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 433/960] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:05.549896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:05.550578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:05.557252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.557693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:05.558462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.558883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:05.594594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a1e5207-a1aa-4117-8bc6-46f1d057f0d9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/action" status: 202 len: 0 microversion: 2.1 time: 1.043191 May 09 09:56:05.596225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 528/961] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 09:56:04 2022] POST /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/action => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:56:05.621474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:05.628852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:05.641525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.642464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:05.643593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.644200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:05.718752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:05.722476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8975807-38b5-4574-9796-2c476c674092 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.123049 May 09 09:56:05.732455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 529/962] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:05.735977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-90d7c380-5b4f-4053-8291-f3c181089906 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.187885 May 09 09:56:05.745101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 434/963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:05 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:05.746201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-cb4630af-41bf-4414-9b4a-2b2c0e9c4a19 req-12ea3ad4-ed51-4830-8b21-263f893ddf8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:56:05.754454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-cb4630af-41bf-4414-9b4a-2b2c0e9c4a19 req-12ea3ad4-ed51-4830-8b21-263f893ddf8a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.754904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-cb4630af-41bf-4414-9b4a-2b2c0e9c4a19 req-12ea3ad4-ed51-4830-8b21-263f893ddf8a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:05.772381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-cb4630af-41bf-4414-9b4a-2b2c0e9c4a19 req-12ea3ad4-ed51-4830-8b21-263f893ddf8a service nova] Creating event network-changed:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 09:56:05.781411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-cb4630af-41bf-4414-9b4a-2b2c0e9c4a19 req-12ea3ad4-ed51-4830-8b21-263f893ddf8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047232 May 09 09:56:05.782021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 530/964] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:56:05.840177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:05.845116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:05.867949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.868437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:05.869256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:05.869683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:06.017743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:06.026474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-475f91c9-5b7f-4038-8132-783616b16c18 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1724 microversion: 2.1 time: 0.192260 May 09 09:56:06.028702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 435/965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:06.744745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:06.745879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:06.752199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:06.752630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:06.753042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:06.753495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:06.753859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:06.753977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:06.761513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:06.761932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:06.762855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:06.763297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:06.790251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-811664ea-057f-4b20-a01e-4b4557a58e66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050241 May 09 09:56:06.794238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 531/966] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:06.827377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:06.835292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd4ab233-cf0c-42df-bd0c-7b20e54ee2e1 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086887 May 09 09:56:06.835870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 436/967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:06.973239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:06.973818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:06.980397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:06.980893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:06.981676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:06.982113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.043430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:07.043957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:07.050095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.050540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.051340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.051775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.184131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:07.194312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1150f047-4239-471c-a05a-0dcaeff08b99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1724 microversion: 2.1 time: 0.154782 May 09 09:56:07.195199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 437/968] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:07.804028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:07.804973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:07.812689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.813329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.814103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.814595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.847434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8b070a4-6dad-4472-9a22-4c74bd6f3cf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048570 May 09 09:56:07.848010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 438/969] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:07.852384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-9e05ddec-8c1f-4338-a05a-3507592f8ee5 req-edc0c3c0-1dd9-4b59-bc8b-e4586a5227f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:56:07.860549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9e05ddec-8c1f-4338-a05a-3507592f8ee5 req-edc0c3c0-1dd9-4b59-bc8b-e4586a5227f0 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.861059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9e05ddec-8c1f-4338-a05a-3507592f8ee5 req-edc0c3c0-1dd9-4b59-bc8b-e4586a5227f0 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.872427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-9e05ddec-8c1f-4338-a05a-3507592f8ee5 req-edc0c3c0-1dd9-4b59-bc8b-e4586a5227f0 service nova] Creating event network-changed:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 09:56:07.877630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-9e05ddec-8c1f-4338-a05a-3507592f8ee5 req-edc0c3c0-1dd9-4b59-bc8b-e4586a5227f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028531 May 09 09:56:07.878245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 439/970] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:56:07.883314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:07.884111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:07.890599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.891042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.891805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:07.892234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:07.953895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:07.962221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8c17079-d14d-452b-9e4c-b8e2a7998bb3 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082701 May 09 09:56:07.962849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 440/971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:07 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:08.214700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:08.215231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:08.222083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:08.222537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:08.223311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:08.223752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:08.360865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:08.369846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-32de07df-9fb7-42d7-8d37-c6b527fbd94a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1724 microversion: 2.1 time: 0.160308 May 09 09:56:08.370736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 441/972] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:08.863619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:08.865166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:08.876068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:08.876869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:08.878142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:08.878863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:08.909653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3e5bf703-67c8-4ab4-a46a-510f0cd4c12c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052852 May 09 09:56:08.910235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 442/973] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:08.979118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:08.979729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:08.986231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:08.986658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:08.987454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:08.987893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.051771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:09.059395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b2bce3e1-f9dd-4839-9e42-11993d52eb56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084028 May 09 09:56:09.059970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 443/974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:08 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:09.389302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:09.390096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:09.396129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:09.396573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.397687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:09.398120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.535845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:09.549753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f968268-6e7f-4eac-b73a-a52deed62034 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1730 microversion: 2.1 time: 0.164725 May 09 09:56:09.550821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 444/975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:09.580163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:09.581077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:09.589184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:09.589633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.590415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:09.591236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.683849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45d12617-7ecb-4704-b086-71eb56c7bbec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109465 May 09 09:56:09.684906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 445/976] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 09:56:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:56:09.922418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:09.923560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:09.930098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:09.930764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.931554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:09.932019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:09.965002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc72b8f4-55fc-4971-ae63-d948fab73cad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046592 May 09 09:56:09.966212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 446/977] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:10.076860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:10.077470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:10.083882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:10.084336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:10.085152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:10.085592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:10.147142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:10.154760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1faa8b59-9e3c-4a91-9209-f66863809af0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.081899 May 09 09:56:10.155326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 447/978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:10 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:10.889546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-824db928-f0a0-43fc-bb08-f7bda93cb1a2 req-7bfb53ca-a067-4720-bd9b-b57800037327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:56:10.897614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-824db928-f0a0-43fc-bb08-f7bda93cb1a2 req-7bfb53ca-a067-4720-bd9b-b57800037327 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:10.898023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-824db928-f0a0-43fc-bb08-f7bda93cb1a2 req-7bfb53ca-a067-4720-bd9b-b57800037327 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:10.909806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-824db928-f0a0-43fc-bb08-f7bda93cb1a2 req-7bfb53ca-a067-4720-bd9b-b57800037327 service nova] Creating event network-changed:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 09:56:10.915022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-824db928-f0a0-43fc-bb08-f7bda93cb1a2 req-7bfb53ca-a067-4720-bd9b-b57800037327 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028946 May 09 09:56:10.916013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 448/979] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 09:56:10.980067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:10.981145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:10.988262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:10.988699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:10.989512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:10.990597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:11.021825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70db73b0-3aeb-4046-9224-cb954338e3ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046232 May 09 09:56:11.022658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 449/980] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:11.173773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:11.174375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:11.180513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:11.180989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:11.182224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:11.182224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:11.244030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:11.253036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e74b02f3-4209-48bf-aed7-800f28e22da2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085034 May 09 09:56:11.253619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 450/981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:11 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:12.037803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:12.039336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:12.050122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:12.050872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:12.052150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:12.052923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:12.083048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df7bd49a-4171-47d0-ac27-5b71d3222d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052001 May 09 09:56:12.083603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 451/982] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:12.273649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:12.274483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:12.281078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:12.281535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:12.282307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:12.282749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:12.351266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:12.359484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56f2851b-454e-4d75-9470-aa99b6744a89 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092176 May 09 09:56:12.360086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 452/983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:12 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:12.934548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-ab2c959e-7008-4e26-8501-6fa7f613b0bb req-66fae157-7ea0-45b3-8074-da6d6c5ffb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 09:56:12.944147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ab2c959e-7008-4e26-8501-6fa7f613b0bb req-66fae157-7ea0-45b3-8074-da6d6c5ffb80 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:12.944634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-ab2c959e-7008-4e26-8501-6fa7f613b0bb req-66fae157-7ea0-45b3-8074-da6d6c5ffb80 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:12.957139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-ab2c959e-7008-4e26-8501-6fa7f613b0bb req-66fae157-7ea0-45b3-8074-da6d6c5ffb80 service nova] Creating event network-changed:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 09:56:12.962598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-ab2c959e-7008-4e26-8501-6fa7f613b0bb req-66fae157-7ea0-45b3-8074-da6d6c5ffb80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 May 09 09:56:12.963236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 453/984] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 09:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 09:56:13.096831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:13.097928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:13.104873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:13.105350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:13.106144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:13.106609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:13.137523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b43220c-fa89-4b11-a536-f300d0057437 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046061 May 09 09:56:13.141240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 454/985] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:56:13.375682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:13.376279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:13.382588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:13.383030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:13.383886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:13.384322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:13.448746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:13.456432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82a62c22-f155-4eab-aac9-d406791c1756 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084744 May 09 09:56:13.457038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 455/986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:13 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:14.154260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:14.155742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:14.166043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:14.166490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:14.167262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:14.167688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:14.197046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-08ecc8d6-0556-4c1d-abc1-983296a2d7d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049727 May 09 09:56:14.197607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 456/987] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:14.475930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:14.476846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:14.485473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:14.486229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:14.487784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:14.487929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:14.567687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:14.575946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3777da0-f845-4e2d-acdc-ad0852caad2c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.106676 May 09 09:56:14.576717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 457/988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:14 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:15.215373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:15.216946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:15.227826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:15.228557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:15.229854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:15.230562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:15.264015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09946edc-4b19-42e7-a0a3-cf24721efaf6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055418 May 09 09:56:15.264560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 458/989] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:15.592939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:15.593550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:15.600339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:15.600821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:15.601598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:15.602143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:15.667946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:15.676335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-34835c92-30d2-48e4-9b4f-00439ec2ca23 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087312 May 09 09:56:15.676965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 459/990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:15 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:16.278489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:16.279617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:16.288089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:16.288683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:16.289668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:16.290100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:16.320513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-22a37d9e-db33-440c-95b9-2982b99feef1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047676 May 09 09:56:16.321141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 460/991] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:16.693561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:16.694164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:16.700902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:16.701352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:16.702153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:16.702579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:16.768692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:16.776888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-22177219-1724-446f-a5b3-990052e8cd34 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087232 May 09 09:56:16.777459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 461/992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:16 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:17.332881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:17.333823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:17.341398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:17.341847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:17.342634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:17.343212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:17.377197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-275dd072-6644-49dd-bd04-e90fa9603879 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048313 May 09 09:56:17.377799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 462/993] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:17.798392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:17.799387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:17.809694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:17.810442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:17.811708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:17.812432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:17.882521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:17.891863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6115c3e3-47c6-42d6-8382-f5e6ac5c87f2 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.100161 May 09 09:56:17.892427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 463/994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:17 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:18.393410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:18.394779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:18.405678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:18.406453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:18.407726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:18.408457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:18.440708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dcee83a6-dda6-4050-9cbe-bf9e7226d970 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054156 May 09 09:56:18.441277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 464/995] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:18.912639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:18.913699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:18.924082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:18.924864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:18.926131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:18.926856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:18.990865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:18.998867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4414508-a152-4d18-9aab-ca5549c884a0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092728 May 09 09:56:18.999429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 465/996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:18 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:19.454790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:19.455993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:19.463927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:19.464398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:19.465189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:19.465620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:19.495012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f11c48c4-5b78-48c8-b389-b3d6e211962b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045607 May 09 09:56:19.495564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 466/997] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:20.019567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:20.020573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:20.030958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:20.031705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:20.033026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:20.033760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:20.096776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:20.104580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5911635-aaaa-4108-809d-fd1418d02f7c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091601 May 09 09:56:20.105177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 467/998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:20 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:20.511541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:20.513081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:20.523930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:20.524381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:20.525187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:20.525626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:20.555363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db7ee7c9-6eed-41d1-a11b-b027339ebe14 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050372 May 09 09:56:20.556196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 468/999] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:21.129799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:21.130776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:21.140893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:21.141641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:21.142914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:21.143639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:21.209380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:21.217375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8102f8c3-594a-4fb5-807b-4741c3994bb8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.094104 May 09 09:56:21.217944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 469/1000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:21 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:21.571319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:21.572241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:21.579013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:21.579460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:21.580218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:21.580649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:21.614508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1df52f6f-61cd-458e-93cf-9d5a43298050 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049705 May 09 09:56:21.615085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 470/1001] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:22.234110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:22.234937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:22.241614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:22.242057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:22.242824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:22.243254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:22.305969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:22.313823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce5704fc-f5fc-4823-ab19-180b80f8c7b9 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083456 May 09 09:56:22.314387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 471/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:22 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:22.632850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:22.634327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:22.645144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:22.645890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:22.647140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:22.647854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:22.677106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc3f26b9-60e6-4f11-88d5-02067cdaab6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050842 May 09 09:56:22.677651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 472/1003] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:23.332174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:23.332952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:23.339877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:23.340323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:23.341143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:23.341573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:23.411758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:23.419339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-24267800-eb15-4047-b89b-130e5f569174 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092044 May 09 09:56:23.419962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 473/1004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:23 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:23.693559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:23.694962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:23.701851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:23.703812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:23.703812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:23.703812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:23.733166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a70ecd0-807e-4372-adea-ea58c593e27c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046525 May 09 09:56:23.733722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 474/1005] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:24.441622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:24.442702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:24.450447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:24.450899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:24.451664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:24.452095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:24.520323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:24.532174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9daec752-4da9-4511-a026-39464f6a15bb tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.096893 May 09 09:56:24.533045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 475/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:24 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:24.747917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:24.749002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:24.757896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:24.758633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:24.759895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:24.760621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:24.794748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-873a4c4e-5661-4552-8344-aa317058ad0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052473 May 09 09:56:24.795301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 476/1007] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:25.553325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:25.554420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:25.561685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:25.562122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:25.562885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:25.563309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:25.624832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:25.632371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-706fd0e2-5fe0-4c92-8d8f-600468169025 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085509 May 09 09:56:25.633041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 477/1008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:25 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:25.810819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:25.812195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:25.822501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:25.823232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:25.824506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:25.825278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:25.858665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-914d052f-fddc-4a67-b374-1e9f321e4f17 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054605 May 09 09:56:25.859246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 478/1009] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:26.653148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:26.654149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:26.664770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:26.665221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:26.665984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:26.666416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:26.741721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:26.750018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9a4bbb4f-e65a-476f-9d6a-02b0f44ff249 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.103483 May 09 09:56:26.750585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 479/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:26 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:26.874347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:26.875714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:26.884943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:26.885386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:26.886150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:26.886576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:26.915933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1139db1-8718-4788-a747-6e474902bc71 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048357 May 09 09:56:26.916482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 480/1011] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:27.767489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:27.768100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:27.774887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:27.775339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:27.776111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:27.776542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:27.842226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:27.850222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2949d90f-27c8-472c-9e7a-0a12fe5f5f55 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086594 May 09 09:56:27.850764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 481/1012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:27 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:27.931312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:27.932514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:27.940794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:27.941348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:27.942371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:27.942948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:27.976283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6da2e05-c764-490b-8a1d-1e011c0e47b7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051301 May 09 09:56:27.977001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 482/1013] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:28.871225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:28.872133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:28.882771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:28.883232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:28.883998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:28.884425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:28.962364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:28.975734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d53c7af-c8d2-45d1-b11a-c41078a31ab0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.110741 May 09 09:56:28.976836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 483/1014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:28 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:28.987466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:28.988388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:28.995062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:28.995514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:28.996349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:28.996826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:29.027623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e243f032-2fcc-49da-8958-868981ed2149 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043905 May 09 09:56:29.028181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 484/1015] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:29.997835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:29.998852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:30.010262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:30.011032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:30.012279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:30.013077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:30.081700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:30.089190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-18af9032-398d-4bf3-a3ef-44eb55d80eb0 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.098453 May 09 09:56:30.089760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 485/1016] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:29 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:30.094349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:30.095243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:30.101141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:30.101578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:30.102323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:30.102744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:30.131650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b74bb10-71a3-4dce-9013-55f884e55eb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040930 May 09 09:56:30.132175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 486/1017] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:31.110296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:31.111339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:31.121885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:31.122621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:31.123869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:31.124573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:31.190377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:31.197865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-264915fd-12b6-4be9-80a1-aa049ee4d5c7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.094164 May 09 09:56:31.198427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 487/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:31 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:31.202914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:31.203797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:31.211458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:31.212045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:31.213286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:31.213890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:31.247164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e71a25d8-6127-4f11-a75e-b89ee518dccc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047765 May 09 09:56:31.247727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 488/1019] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:32.218698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:32.219831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:32.230725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:32.231440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:32.232724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:32.233495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:32.297140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:32.304941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-271f9db9-00c6-4f4c-a832-9d599501aa63 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092731 May 09 09:56:32.305517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 489/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:32 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:32.310186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:32.311122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:32.316952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:32.317397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:32.318161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:32.318593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:32.348061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72b64484-2e41-4dd4-a45a-eb9d451cc69e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041434 May 09 09:56:32.348606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 490/1021] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:33.323853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:33.324803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:33.333055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:33.333654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:33.334678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:33.335246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:33.402531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:33.410424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7cbbd904-d1d3-456c-85ed-bfc4aa6ff50a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.092036 May 09 09:56:33.410996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 491/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:33 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:33.415636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:33.416531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:33.422359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:33.422822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:33.423574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:33.424001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:33.453169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a89671c0-049d-497d-981f-e21eac075f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041091 May 09 09:56:33.453728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 492/1023] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:34.431240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:34.432339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:34.442882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:34.443627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:34.445018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:34.445453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:34.507402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:34.515017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b2982546-a267-4c5e-acdb-4b26a8081eb6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.090419 May 09 09:56:34.515588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 493/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:34 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:34.520057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:34.520990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:34.527066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:34.527519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:34.528282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:34.528745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:34.557442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89af41d9-9537-4ca9-a468-d9e87b56dfc8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040866 May 09 09:56:34.558052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 494/1025] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:35.531898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:35.532730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:35.539222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:35.539671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:35.540456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:35.540922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:35.604574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:35.612391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff555c25-c4f1-4a87-a3bc-9d55c6d059fc tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084425 May 09 09:56:35.613004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 495/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:35 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:35.617543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:35.618446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:35.625482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:35.625933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:35.626731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:35.627167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:35.655915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8c466d70-bd4b-425a-90bb-0879543552ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041884 May 09 09:56:35.656482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 496/1027] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:36.630911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:36.631586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:36.638550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:36.639026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:36.639845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:36.640290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:36.700646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:36.708397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-febf5072-9e10-49dd-a9e6-b0870e4c0c1b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.081679 May 09 09:56:36.709002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 497/1028] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:36 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:36.713731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:36.714625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:36.721084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:36.721528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:36.722287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:36.722712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:36.752009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4fc75d9c-f80a-4290-b813-505b49e8dd2d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041964 May 09 09:56:36.752534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 498/1029] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:37.725597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:37.726218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:37.732979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:37.733415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:37.734170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:37.734595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:37.797765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:37.805690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-440a5872-3563-4bd4-884a-c035d1a85c56 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084030 May 09 09:56:37.806268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 499/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:37 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:37.810887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:37.811733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:37.817729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:37.818173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:37.818942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:37.819411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:37.848629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d233ad26-633f-445f-9154-fc172729f9ce tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041306 May 09 09:56:37.849213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 500/1031] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:38.823634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:38.824326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:38.830718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:38.831171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:38.831944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:38.832383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:38.898934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:38.908036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a32cab00-1bb7-468d-86b7-9cbecc7006e8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088450 May 09 09:56:38.908871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 501/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:38 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:38.914727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:38.915911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:38.922874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:38.923470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:38.924373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:38.924958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:38.955824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7889f5b5-0136-44a4-986c-e74590c45aac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045707 May 09 09:56:38.956382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 502/1033] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:39.207566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:56:39.207838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 09:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 09:56:39.925517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:39.926215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:39.933000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:39.933444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:39.934216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:39.934648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:40.006408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:40.014525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53551695-f668-4421-9530-c963c217a5b7 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.093039 May 09 09:56:40.015108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 503/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:39 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:40.019693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:40.020611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:40.027013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:40.027459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:40.028226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:40.028653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:40.057982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-636421d2-81c5-4413-9cde-51db71415c81 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041878 May 09 09:56:40.058556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 504/1035] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:41.031307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:41.031981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:41.038687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:41.039216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:41.039962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:41.040395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:41.103010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:41.113824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2d29395-0d67-42fb-a961-a87bc3ed980a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.086294 May 09 09:56:41.114714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 505/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:41 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:41.121392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:41.122774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:41.129112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:41.129561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:41.130325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:41.130759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:41.159484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8aaf8ef7-68b5-457e-a35d-16b4da3527cc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043478 May 09 09:56:41.160045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 506/1037] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:42.134998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:42.136073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:42.146199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:42.146839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:42.147963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:42.148395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:42.212717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:42.220385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bef4f973-2df7-427d-8cbd-0cdf369ef200 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.091697 May 09 09:56:42.221288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 507/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:42 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:42.225938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:42.226838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:42.232769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:42.233220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:42.233972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:42.234397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:42.263021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8084af1-d9e2-4eb8-86c2-f6a863202d23 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040715 May 09 09:56:42.263574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 508/1039] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:43.238146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:43.238864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:43.245224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:43.245668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:43.246429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:43.246852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:43.310230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:43.319501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23284da4-1a6a-41db-9d7b-50bccb9c2830 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085114 May 09 09:56:43.320195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 509/1040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:43 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:43.324851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:43.325764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:43.331746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:43.332199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:43.333016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:43.333463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:43.361884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-063fdf6f-69b3-4728-8cd1-f50d8ad67d56 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040623 May 09 09:56:43.362435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 510/1041] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:44.335682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:44.336435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:44.343067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:44.343510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:44.344280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:44.344717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:44.408524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:44.416780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d05716d2-6f07-4f0f-b67c-678620235b4f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085099 May 09 09:56:44.417373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 511/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:44 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:44.422092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:44.422989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:44.429313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:44.429758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:44.430741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:44.431176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:44.461797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-03fa879f-0be5-4405-94de-2f6d7380ea0c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043338 May 09 09:56:44.462329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 512/1043] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:45.434002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:45.434834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:45.441356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:45.441830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:45.442585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:45.443015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:45.504250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:45.512155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed1b8fa6-0df4-4bf9-8462-0a16a90c20af tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082157 May 09 09:56:45.512732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 513/1044] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:45 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:56:45.517691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:45.518520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:45.524472 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:45.525013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:45.525804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:45.526233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:45.555861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36172675-8041-4ca8-827a-2bdcaccd9c5d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042064 May 09 09:56:45.556417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 514/1045] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:46.529154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:46.529840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:46.536453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:46.536967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:46.537718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:46.538138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:46.601089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:46.608614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4fa414b5-712b-43e0-ad7a-ede23a35bb3c tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083547 May 09 09:56:46.609208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 515/1046] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:46 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:46.613779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:46.614677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:46.620435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:46.620909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:46.621663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:46.622085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:46.651283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77bc3cf2-04c8-45a2-b2be-fb6a5674aa88 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041064 May 09 09:56:46.651832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 516/1047] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:47.625414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:47.626098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:47.632795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:47.633238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:47.633997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:47.634425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:47.695806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:47.703644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d135f3b3-86c7-4bb9-8abc-034dc265716a tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082095 May 09 09:56:47.704213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 517/1048] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:47 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:47.708738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:47.709616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:47.715618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:47.716059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:47.716846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:47.717276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:47.746655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-436f9b25-d28c-4db3-8656-1120fcd8122b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041388 May 09 09:56:47.747210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 518/1049] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:48.722951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:48.723653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:48.730470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:48.731001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:48.731853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:48.732327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:48.798122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:48.806965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fb6a5a4-9069-4228-af22-4ca0ca05b51f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088285 May 09 09:56:48.807615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 519/1050] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:48 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:48.812725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:48.813625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:48.820206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:48.820812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:48.821677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:48.822192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:48.852995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d0bf1463-f6d5-4a3b-917e-fc6c4a30f2f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 May 09 09:56:48.853577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 520/1051] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:49.823808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:49.824517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:49.830944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:49.831385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:49.832144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:49.832576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:49.894078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:49.902081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-38e646e7-edd7-4b13-9877-bb766d180fde tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.082157 May 09 09:56:49.902643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 521/1052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:49 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:49.907872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:49.908978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:49.917485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:49.918007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:49.919129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:49.919661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:49.953710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6c62d903-7806-4f4a-bad4-e0cfcf8c1707 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050034 May 09 09:56:49.954269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 522/1053] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:50.918526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:50.919223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:50.925825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:50.926270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:50.927042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:50.927469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:50.991802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:50.999422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2579935e-e54f-4a7e-b864-4cea321ed7fd tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084947 May 09 09:56:50.999980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 523/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:50 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:51.004542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:51.005465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:51.012303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:51.012769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:51.014585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:51.015025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:51.045247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5547237-4d9d-46df-be48-e215130192cb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044152 May 09 09:56:51.045886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 524/1055] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:52.017223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:52.017921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:52.024859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:52.025310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:52.026078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:52.026508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:52.091857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:52.100851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-133f5d23-97c1-43d4-bfd4-9ce561cce0ce tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087413 May 09 09:56:52.101511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 525/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:52 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:52.107022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:52.108014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:52.114780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:52.115229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:52.116001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:52.116433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:52.304327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4708bae3-e07d-4335-9e17-e14c1422bf97 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201677 May 09 09:56:52.304924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 526/1057] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:53.117976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:53.118693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:53.125015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:53.125452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:53.126210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:53.126635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:53.189673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:53.197249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ca74915-83da-479e-99bb-780336e21613 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083337 May 09 09:56:53.197794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 527/1058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:53 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:53.315975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:53.316926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:53.323027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:53.323475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:53.324246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:53.324705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:53.360876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef1b5cfd-8586-4786-81e0-64e5b59df4cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049010 May 09 09:56:53.361432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 528/1059] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:56:54.214031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:54.214738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:54.221724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:54.222178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:54.222954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:54.223390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:54.283633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:54.291230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea4ac6d1-fb9e-4af7-9a98-18203d866d77 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.081098 May 09 09:56:54.291822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 529/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:54 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:54.373222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:54.374168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:54.380357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:54.380855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:54.381704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:54.382164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:54.411421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-744dd457-0c8e-4c31-a384-9307707f4bd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042195 May 09 09:56:54.411974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 530/1061] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:55.307582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:55.308453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:55.314818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:55.315266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:55.316017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:55.316480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:55.377597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:55.385668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-223f504e-a654-4c36-b3a6-bd32aa05555f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.081918 May 09 09:56:55.386237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 531/1062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:55 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:55.423913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:55.424983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:55.432220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:55.432774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:55.433670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:55.434178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:55.466482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-974413ed-4463-4b6c-afcc-5e7422580804 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046851 May 09 09:56:55.467284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 532/1063] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 09 09:56:56.403475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:56.404188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:56.410980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:56.411426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:56.412201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:56.412688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:56.475348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:56.483103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1feff78-d81f-4d2a-8c62-d7c4b05857df tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083611 May 09 09:56:56.483667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 533/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:56 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:56.488459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:56.489422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:56.495835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:56.496281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:56.497101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:56.497516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:56.527000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dfb12ba6-64f8-44af-9c5a-cb4d1235a023 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042280 May 09 09:56:56.527546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 534/1065] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:57.500975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:57.501684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:57.508352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:57.508823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:57.509583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:57.510008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:57.573997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:57.581670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c86a5efb-aae7-423b-abba-a914214d07ee tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084593 May 09 09:56:57.582215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 535/1066] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:57 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:57.586897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:57.587798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:57.593696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:57.594143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:57.594897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:57.595650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:57.623877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63a375ab-ee14-4000-b250-40add1ca0443 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040652 May 09 09:56:57.624423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 536/1067] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:58.598693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:58.599389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:58.606019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:58.606465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:58.607218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:58.607641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:58.670701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:58.678522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a93bb0b-00fd-47e2-bdc8-138f7bbb3c68 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.084035 May 09 09:56:58.679077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 537/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:58 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:58.683638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:58.684574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:58.691186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:58.691655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:58.692487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:58.693008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:58.725158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2459804a-395a-427b-874d-3da320fbe321 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044980 May 09 09:56:58.725758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 538/1069] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:56:59.695282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:59.695950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:59.702482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:59.702933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:59.703705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:59.704143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:59.765904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:56:59.774269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-745b6d9f-1a58-4a4a-ae14-7c40a2b759be tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083136 May 09 09:56:59.774868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 539/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:56:59 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:56:59.779895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:56:59.780928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:56:59.787285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:59.787985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:59.789006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:56:59.789524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:56:59.820566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c82a711-b98f-48ff-91d4-3c2eccfbe3f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044547 May 09 09:56:59.821136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 540/1071] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:56:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:00.791488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:00.792203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:00.799568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:00.800065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:00.800993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:00.801488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:00.866793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:57:00.875469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c59c8fff-c802-45aa-836d-9760e3d24363 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.088177 May 09 09:57:00.876106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 541/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:57:00 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:57:00.881139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:00.882170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:00.888607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:00.889172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:00.890138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:00.890679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:00.923143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c90bcb44-9bff-4efc-be93-543bb76765c3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045905 May 09 09:57:00.923758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 542/1073] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:57:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:01.893683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:01.894346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:01.901099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:01.901582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:01.902440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:01.902932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:01.967320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:57:01.976676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b5bd3bd-c471-4ff4-99f7-8a7db6721e85 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087445 May 09 09:57:01.977255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 543/1074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:57:01 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:57:01.981956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:01.982866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:01.990803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:01.991310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:01.992266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:01.992796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:02.024120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-69ab87a1-38f3-4e1b-9418-fa2e67bb2c45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 May 09 09:57:02.024679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 544/1075] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:57:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:02.993573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:02.994264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:03.000928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:03.001376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:03.002140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:03.002570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:03.062517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:57:03.070100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91a0c3fb-9681-41f3-be6f-f8faaf67888d tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.080763 May 09 09:57:03.070662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 545/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:57:02 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:57:03.075168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:03.076084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:03.081764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:03.082209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:03.082974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:03.083405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:03.112650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b5a3e34-a357-4b5a-adfc-e7e97e4b4756 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040984 May 09 09:57:03.113221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 546/1077] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:57:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:04.088382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:04.089468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:04.096906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:04.097371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:04.098153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:04.098601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:04.160235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:57:04.167829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6db7fe1-ded2-4213-a84a-a2ea3b38ffdf tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.083782 May 09 09:57:04.168420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 547/1078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:57:04 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:57:04.172959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:04.173855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:04.179608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:04.180056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:04.180857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:04.181289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:04.209616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef140316-9d68-4a0e-a42d-88a8a229dab5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040149 May 09 09:57:04.210165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 548/1079] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:57:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:05.184194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:05.184942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:05.191777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:05.192225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:05.193021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:05.193453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:05.256055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:57:05.265526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ab0f06a-e343-409f-9b0d-89486bb6515b tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085176 May 09 09:57:05.266170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 549/1080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:57:05 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 09:57:05.271395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:05.272509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:05.279224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:05.279672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:05.280440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:05.280904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:05.310206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a59e22bc-3021-4a2f-9074-a68e37c2c699 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042879 May 09 09:57:05.310742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 550/1081] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:57:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:06.282785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:06.283507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:06.290303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:06.290748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:06.291515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:06.291953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:06.356432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:57:06.364151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-375ba505-0591-41a0-a545-952a4402172f tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085411 May 09 09:57:06.364735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 551/1082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:57:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:57:06.369380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:06.370299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:06.376143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:06.376588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:06.377384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:06.377817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:06.406594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a97aab8c-9c82-48cd-8cc0-a960a7544174 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040836 May 09 09:57:06.407154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 552/1083] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:57:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:57:07.032500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:57:07.033024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:57:07.039485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:07.039932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:57:07.040736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:57:07.041224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:04.674477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:58:04.826784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 09:58:06.230692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2327aac9-8cd5-484f-8d71-eac215b401b1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 202 len: 0 microversion: 2.1 time: 119.262680 May 09 09:58:06.231469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 532/1084] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:56:06 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 0 bytes in 119264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 09:58:06.237338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:58:06.238033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:58:06.244393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.244978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.245633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.246721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.258467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 09:58:06.263576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 09:58:06.265084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 09:58:06.265788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 09:58:06.266952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:58:06.268155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:58:06.271155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) May 09 09:58:06.273468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 09:58:06.277334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8bc1946d-a6cd-4269-ad4c-02ea41fc0962) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 09:58:06.277920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1836af23-544a-4de6-992a-9fbf5473456a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 59.248199 May 09 09:58:06.284085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 553/1085] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:57:07 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 59256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 09:58:06.317852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 09:58:06.321971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83dfbb6b-da2f-42ad-b04a-59a02de2ad17 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.089094 May 09 09:58:06.322779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 533/1086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 09:58:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 09:58:06.327636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:58:06.328204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:58:06.334674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.335379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.336237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.336889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.374250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:58:06.375808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:58:06.381864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.382540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.383310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.383741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.419205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d3d58e02-b559-4604-8710-47d18d3d3991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.133112 May 09 09:58:06.419674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 554/1087] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 09:58:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 09:58:06.424457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 09:58:06.424969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 09:58:06.430700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.431132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:58:06.431880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 09:58:06.432305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 09:59:00.378013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:59:00.379119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 09:59:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 09:59:05.010693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:59:05.011352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 09:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 09:59:11.886144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:59:11.886673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 09:59:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 (ip 10.222.0.26) !!! May 09 09:59:20.142118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:59:20.142875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 09:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 (ip 10.222.0.26) !!! May 09 09:59:59.217576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 09:59:59.218390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 09:59:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 (ip 10.222.0.26) !!! May 09 10:00:05.061977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:00:05.101404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:00:06.456921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-03fcf1fa-9dee-4bc9-89aa-351dba156fe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 202 len: 0 microversion: 2.1 time: 120.132962 May 09 10:00:06.457893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 534/1088] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:58:06 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 0 bytes in 120135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:00:06.478360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:00:06.481664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:00:06.484431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:00:06.486804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:00:06.488135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:00:06.489570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:00:06.490811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) May 09 10:00:06.492126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:00:06.497143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b626be34-6a83-43a6-bba2-d7a10e6e03ac) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:00:06.497143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42271350-956e-4ab6-881d-69bdb277c934 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 120.061707 May 09 10:00:06.497143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 555/1089] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 09:58:06 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 120063 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:00:06.497143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:00:06.497678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:00:06.497977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.498415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.499661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.499849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.533276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e99583fa-48d8-4816-9ec8-14645c51d520 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048937 May 09 10:00:06.534089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 556/1090] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:00:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:00:06.539337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:00:06.540136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:00:06.546301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.546736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.547535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.547962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.593013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:00:06.593774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:00:06.600187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.601052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.601854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.602293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.665270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:00:06.673005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b7ec5ae-e53f-4b06-a0d2-5dd6f3682415 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.213920 May 09 10:00:06.673607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 535/1091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:00:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:00:06.678213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:00:06.678747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:00:06.684810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.685301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:00:06.686095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:00:06.686561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:05.390466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:02:05.544199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:02:06.715751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:02:06.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:02:06.719715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:02:06.720854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:02:06.724126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.726339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:02:06.728170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) May 09 10:02:06.729656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:02:06.731654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d0183f64-1a62-4e99-9fc8-407e1ef12c1d) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:02:06.731654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3fd27c4d-cae6-4f9a-8949-f334b7d53b12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 400 len: 269 microversion: 2.1 time: 120.185812 May 09 10:02:06.731654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 557/1092] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:00:06 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 269 bytes in 120187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:02:06.731654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:02:06.732142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:02:06.735413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.735854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.736625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.737104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:02:06.753081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:02:06.755488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:02:06.756257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:02:06.757614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.759097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:02:06.765901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) May 09 10:02:06.767300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:02:06.768774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9724df69-f296-45ee-ba34-2b920696cc8a) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:02:06.768774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d3e6f53-29ef-4ea9-be7f-193bffdcb1ae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 120.085708 May 09 10:02:06.768774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 536/1093] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:00:06 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 120087 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:02:06.771554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:02:06.772858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:02:06.779960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.780448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.781277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.781715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.800904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:02:06.808520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17228e2c-5a52-485d-a310-655f17562043 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.085332 May 09 10:02:06.809137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 558/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:02:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:02:06.812621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6b5240b-67b1-4776-a244-d3a4ed95d2ca tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050593 May 09 10:02:06.813550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 537/1095] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:02:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:02:06.813738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:02:06.814228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:02:06.820507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.820630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.821412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.821847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.951434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:02:06.951957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:02:06.958314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.958750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:06.959612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:02:06.960036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:02:20.391456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:02:20.392404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:02:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 (ip 10.222.0.26) !!! May 09 10:02:25.021017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:02:25.021989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 (ip 10.222.0.26) !!! May 09 10:02:31.895903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:02:31.896740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:02:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 10:02:40.151360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:02:40.152052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 10:02:58.797772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:02:58.798432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:02:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 (ip 10.222.0.26) !!! May 09 10:03:19.230264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:03:19.231060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b (ip 10.222.0.26) !!! May 09 10:04:05.813839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:05.914139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'services' on Instance uuid b7944fa2-ab61-4f7b-b2b1-799f6cd80268 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:05.941201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:05.943482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:05.945181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:05.946062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:05.947165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:05.948318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:05.949380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) May 09 10:04:05.950463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:05.951514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-16dd292b-71ad-4ce5-9683-04fbb87bb615) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:05.951514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cfa70a9c-f360-4b01-a248-77fe3c2e8d4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 400 len: 269 microversion: 2.1 time: 119.134809 May 09 10:04:05.951514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 559/1096] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:02:06 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 269 bytes in 119136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:05.951514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:05.951989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:05.958394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:05.958884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:05.959688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:05.960125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.001220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2558c2f4-5183-4726-9d3c-72b1204b1db5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8" status: 202 len: 0 microversion: 2.1 time: 119.186433 May 09 10:04:06.001967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 538/1097] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:02:06 2022] DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 => generated 0 bytes in 119188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:04:06.008174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.009290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.015545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.016000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.016810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.017397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.052187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-859a8258-e4ff-4bc6-9557-4cf363729463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048650 May 09 10:04:06.052715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:06.052892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 539/1098] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:06.057804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.058421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.065668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.066250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.067164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.067606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.107148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:06.109335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:06.110817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.111512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.113080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.114543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.115879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) May 09 10:04:06.117918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.120585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-381d94f4-3983-493a-b49d-87c53fc5ec58) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:06.120585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f3684b59-a612-4a49-b9f3-54ed1292f76e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 0.164079 May 09 10:04:06.120585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 560/1099] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:05 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:06.134683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:04:06.141783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7480f64b-af32-4478-a4f6-80d44985baa6 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1225 microversion: 2.1 time: 0.087837 May 09 10:04:06.142564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 540/1100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:04:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:04:06.148342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.148867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.155301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.155745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.156521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.156993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.246733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:06.261287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.262438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.271456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.271910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.272712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.273170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.306168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-58ee9302-3787-490c-8f69-5bf4ac49819e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193653 May 09 10:04:06.307132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 561/1101] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:04:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:04:06.311985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.312470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.312648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:06.316759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:06.318186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.318803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.319857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.323225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.325886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) May 09 10:04:06.330521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.332873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-709d53dc-8fff-4fe5-af11-2cc4d165d113) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:06.332873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-af60de61-3f22-4500-a299-155fb29e310d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 400 len: 269 microversion: 2.1 time: 0.175091 May 09 10:04:06.332873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 541/1102] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:06 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 269 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:06.333320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.333320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.333320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.333320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.333961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.333961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.333961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.333961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.334611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.334611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.413596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'services' on Instance uuid b7944fa2-ab61-4f7b-b2b1-799f6cd80268 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:06.458169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:06.813465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Request method failure captured: May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 HTTP/1.1 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZgQqgFypzC-vfKjyWf5-WrWQe7QWEoDIj1YMlewhejJTkoc3u0bLwOXU2Ij5F3OaY8ffR7xhBoRbfkHP0tcLHrmLvwkj9kndJ8yXtooHWZiQLTO2pF9PY-ly7pOTdW2BPH6pRjNlNeIKXSvMBhCBlb77xpqsZcd7zAxWyXki38P8 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:06.815530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_084ec4bab56b4c1d823158e34705bbf0", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 17a673de26884004bc852ef76b18aa06 May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:06.818337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'b7944fa2-ab61-4f7b-b2b1-799f6cd80268', 'id': 'c04f4883-b536-4341-9152-cbe004698fe8'} May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.820121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.822619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.825160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.826826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) May 09 10:04:06.829638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:06.831882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1787aea2-a234-4591-9356-49924bf7e5cd) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:06.831882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9fe6733a-9e8f-46e6-a820-bfe73109dffc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8" status: 400 len: 269 microversion: 2.1 time: 0.508857 May 09 10:04:06.831882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 562/1103] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:06 2022] DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 => generated 269 bytes in 510 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:06.831882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.833565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.833565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.833565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.833565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.833910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.855459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:06.857845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:06.859215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.859822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:06.860944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.862257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.863461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) May 09 10:04:06.864893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:06.866753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-62f001db-5826-421a-bb8a-1592dbbb6b73) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:06.866753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-428b5b5e-c1f2-4dea-9658-959aa3db64ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 0.539077 May 09 10:04:06.866753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 542/1104] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:06 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 540 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:06.866753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.867243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.867378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14b56d08-0810-493b-9f15-0c519b356074 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047148 May 09 10:04:06.867378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 563/1105] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:06.871633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.871836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.872285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.872541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.873125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.873683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.879555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.879555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.880069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.880505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.906038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.906566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.907071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lazy-loading 'fault' on Instance uuid f2554f24-99b6-4ba6-91e9-9ec6289fbda0 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:06.913822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-edf388c9-c315-4553-b3c3-a9f64e5e0b10 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045728 May 09 10:04:06.914728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 564/1106] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:04:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:04:06.921539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.922028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.928754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.929231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.930046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.930503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.956066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:04:06.964258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f7ae5d2-c546-4659-9e2f-c019769acc0e tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1230 microversion: 2.1 time: 0.103251 May 09 10:04:06.964878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 543/1107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:04:06 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:04:06.969534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:06.970024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:06.976175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.976621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:06.977424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:06.977858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.018262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.062330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'services' on Instance uuid b7944fa2-ab61-4f7b-b2b1-799f6cd80268 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.098064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:07.100260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:07.101835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.103203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.105221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.107080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.108280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) May 09 10:04:07.109604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.111265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c8ef4409-0bcf-4503-bc47-4605ec953efd) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.111265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-338c41e9-b92c-44b3-b7f2-7527e1090877 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 400 len: 269 microversion: 2.1 time: 0.185512 May 09 10:04:07.111265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 565/1108] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:06 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 269 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.111265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.111678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.114488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.114971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.115706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.116125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.133528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Request method failure captured: May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 HTTP/1.1 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOPZgQqgFypzC-vfKjyWf5-WrWQe7QWEoDIj1YMlewhejJTkoc3u0bLwOXU2Ij5F3OaY8ffR7xhBoRbfkHP0tcLHrmLvwkj9kndJ8yXtooHWZiQLTO2pF9PY-ly7pOTdW2BPH6pRjNlNeIKXSvMBhCBlb77xpqsZcd7zAxWyXki38P8 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:07.135917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_084ec4bab56b4c1d823158e34705bbf0", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 17a673de26884004bc852ef76b18aa06 May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:07.138696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'b7944fa2-ab61-4f7b-b2b1-799f6cd80268', 'id': 'c04f4883-b536-4341-9152-cbe004698fe8'} May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.139538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.140568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.144384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.146863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) May 09 10:04:07.149289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.151807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227256b-a068-4645-b282-7c672cd55f5a) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.151807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f9c3ec04-34d1-49a5-88ce-183f0a9bf361 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8" status: 400 len: 269 microversion: 2.1 time: 0.171413 May 09 10:04:07.151807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 544/1109] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:06 2022] DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 => generated 269 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.151807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.152986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.152986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.152986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.152986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.154066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.185016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8afecb5-b1b2-4522-a6f5-2c8711a4e6c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045842 May 09 10:04:07.185845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 545/1110] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:07.190416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.190850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.197141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.197605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.198446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.198842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.207269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.232753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.233436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.234933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lazy-loading 'fault' on Instance uuid f2554f24-99b6-4ba6-91e9-9ec6289fbda0 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.266838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:07.269026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:07.270850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.271504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.272504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.273684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.274699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) May 09 10:04:07.275792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.276848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-faf12576-0603-404e-9f44-c3ad04b8e66f) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.276848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e8b70ac-6eef-415b-8d42-d815a626c5f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 0.166842 May 09 10:04:07.276848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 566/1111] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.281828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.283174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.291454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.291765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c091a71e2ad46ceafe25be874c016a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c36cb22c2846e480c26840635bf29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:04:07.293027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.294375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.295012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.300455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f27130a8-435c-4d9b-aa6d-9b479072f3a8 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 200 len: 1230 microversion: 2.1 time: 0.113761 May 09 10:04:07.301796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 546/1112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:04:07.307583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.308147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.315223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.315665 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.316439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.316967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.329000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f898d9e-7f1f-40a0-a11d-4eeab99f4d1e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050986 May 09 10:04:07.329803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 567/1113] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:04:07.334402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.335054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.344400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.344905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.345688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.346119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.407209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.450417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'services' on Instance uuid b7944fa2-ab61-4f7b-b2b1-799f6cd80268 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.477654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:07.480209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:07.481829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.482457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.484264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.486134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.487464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) May 09 10:04:07.488865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.490438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9b040614-e67f-4e2c-a324-939bfe299501) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.490438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ae516ce0-c2f4-4554-8912-498b019a5f78 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 400 len: 269 microversion: 2.1 time: 0.178965 May 09 10:04:07.490438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 547/1114] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 269 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.490438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.490793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.496113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.496561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.497468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.497893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.514673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Request method failure captured: May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 HTTP/1.1 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZgQqgFypzC-vfKjyWf5-WrWQe7QWEoDIj1YMlewhejJTkoc3u0bLwOXU2Ij5F3OaY8ffR7xhBoRbfkHP0tcLHrmLvwkj9kndJ8yXtooHWZiQLTO2pF9PY-ly7pOTdW2BPH6pRjNlNeIKXSvMBhCBlb77xpqsZcd7zAxWyXki38P8 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:07.516887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_084ec4bab56b4c1d823158e34705bbf0", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 17a673de26884004bc852ef76b18aa06 May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:07.519357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'b7944fa2-ab61-4f7b-b2b1-799f6cd80268', 'id': 'c04f4883-b536-4341-9152-cbe004698fe8'} May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.521583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.523561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.526644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) May 09 10:04:07.529368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.531452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ee02f111-511c-407c-a0b2-6e4558424a10) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.531452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-35bc6c2b-e97e-4d0e-9a5d-72d9b281ccb1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8" status: 400 len: 269 microversion: 2.1 time: 0.187820 May 09 10:04:07.531452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 568/1115] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.531452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.532043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.532043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.532043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.532043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.532619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.570020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a28ccf57-fbe9-41cf-ae09-33c16c081f26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050145 May 09 10:04:07.570610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 569/1116] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:07.575268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.575878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.582818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.583244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.584027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.584461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.592034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.598725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] HTTP exception thrown: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Request method failure captured: May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 HTTP/1.1 May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieONX71zCuFMU8WfmrGILrV7NP-SXrBrCKtPu65DQ436-_5EJ18qTqTDVwENBch8xphDMDb2uWO1HzfLjEnJZPiZcuM7IS_z3FefG_mkA4oHW79QnGL0jNi4wB86gAfzFtMW5r5YcOmDU1-Tg7z1WwVeAT3WcjHbK9enECDBonmmr1ec May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:07.600626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_39c36cb22c2846e480c26840635bf29c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 1c091a71e2ad46ceafe25be874c016a6 May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:07.602267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'f2554f24-99b6-4ba6-91e9-9ec6289fbda0'} May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.603518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:07.604775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.605903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Returning 404 to user: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.605903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-98e7fd7a-8cdb-4e16-a20d-0b4a9e9b1664 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 404 len: 111 microversion: 2.1 time: 0.030520 May 09 10:04:07.605903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 570/1117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:04:07.607849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.608758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.615521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.615695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.616467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.617041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.652278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-159e6d9f-70dc-46f4-a21f-35617a474bd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048127 May 09 10:04:07.657255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 571/1118] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:04:07.660028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.661310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.662435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:07.665527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:07.667837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.668605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.670298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.671857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.673239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) May 09 10:04:07.674539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.675780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-deef75cd-3f38-4540-a5f7-d1b360dba158) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.675780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53ea9992-db9a-48b9-8427-0904bd11d662 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 0.183902 May 09 10:04:07.675780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 548/1119] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.675780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.676200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.679093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.679550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.680526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.681018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.681336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.681907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.682789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.683290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.765741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'services' on Instance uuid cff08bd0-07e6-4fd9-9dba-ed7381d86652 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.807510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lazy-loading 'services' on Instance uuid b7944fa2-ab61-4f7b-b2b1-799f6cd80268 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:07.838661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b HTTP/1.1 May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:07.840831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:04:07.842515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'cff08bd0-07e6-4fd9-9dba-ed7381d86652', 'id': 'd939d91f-94b1-4238-b109-48ff177d865b'} May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.843388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.844460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.846345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.847886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) May 09 10:04:07.849429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:07.850460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f2ee0bee-f6dd-4826-8392-8edc94b38e3f) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.850460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-770d91ae-5d92-4e71-b2e1-7391b5fed0c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b" status: 400 len: 269 microversion: 2.1 time: 0.187705 May 09 10:04:07.850460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 572/1120] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments/d939d91f-94b1-4238-b109-48ff177d865b => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.850460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.850825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.854878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.855323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.856138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.856520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.881051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Request method failure captured: May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 HTTP/1.1 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOPZgQqgFypzC-vfKjyWf5-WrWQe7QWEoDIj1YMlewhejJTkoc3u0bLwOXU2Ij5F3OaY8ffR7xhBoRbfkHP0tcLHrmLvwkj9kndJ8yXtooHWZiQLTO2pF9PY-ly7pOTdW2BPH6pRjNlNeIKXSvMBhCBlb77xpqsZcd7zAxWyXki38P8 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:07.881921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/084ec4bab56b4c1d823158e34705bbf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_084ec4bab56b4c1d823158e34705bbf0", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 084ec4bab56b4c1d823158e34705bbf0 May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1017941071 May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 17a673de26884004bc852ef76b18aa06 May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesSnapshotTestJSON-1017941071-project May 09 10:04:07.888398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'b7944fa2-ab61-4f7b-b2b1-799f6cd80268', 'id': 'c04f4883-b536-4341-9152-cbe004698fe8'} May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.889193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:07.890447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.891878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.893126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) May 09 10:04:07.894302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:07.895697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-42fa1f5f-0fe2-4b1d-868f-0856de5270c2) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:07.895697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d70753aa-49e1-4387-a582-97286c966b87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8" status: 400 len: 269 microversion: 2.1 time: 0.213965 May 09 10:04:07.895697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 549/1121] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268/os-volume_attachments/c04f4883-b536-4341-9152-cbe004698fe8 => generated 269 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:07.895697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:07.896072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:07.898907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.899453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.900286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:07.900795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:07.932949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-87a0dc39-c141-4e72-9560-39e69b266ef0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048163 May 09 10:04:07.933727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 550/1122] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:07.941771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1669500027", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-199242016", "security_groups": [{"name": "tempest-secgroup-smoke-785039601"}], "block_device_mapping_v2": [{"uuid": "0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff83fa46-d09c-4426-9a64-8ad4e2ae8c64"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:04:07.986763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lazy-loading 'services' on Instance uuid ba59db3d-90cd-4f89-9b7a-31e36bab75eb {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:04:08.060536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Request method failure captured: May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 HTTP/1.1 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOPZKhkLx6321B8D3K8BobN8zJV3zjGsauFa0EYTIhM3UpXxddTMYo01XmnM4wKRkQD0EPPJQvl5rSdXr9kYgcFuyw_k8G5diN_U1DgD6vCtSjuA9mA2hWgSeyWkr3fwCCxMFF4ReY-nPnASR6uHcRAuGRASMS5Gv1THOWdeAs0SYR4 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:08.062922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b1c46939bf6f40f19dac93cf5d494ab1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b1c46939bf6f40f19dac93cf5d494ab1", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: b1c46939bf6f40f19dac93cf5d494ab1 May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875371807 May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cba3e3a904ca41b78e518699f88e315e May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestMinimumBasicScenario-875371807-project May 09 10:04:08.064438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': 'ba59db3d-90cd-4f89-9b7a-31e36bab75eb', 'id': '8d27c057-3210-4a3e-bb02-7ef939eb6da7'} May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:08.065231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:08.066477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.067831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:08.068935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) May 09 10:04:08.070226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:08.072138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-87cb1fb5-3b9e-465d-ab2a-a9acac5c5337) {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:08.072138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1be8bd89-0f2d-483e-98b8-d78cb25a11be tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7" status: 400 len: 269 microversion: 2.1 time: 0.221272 May 09 10:04:08.072138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 573/1123] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:04:07 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb/os-volume_attachments/8d27c057-3210-4a3e-bb02-7ef939eb6da7 => generated 269 bytes in 224 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:08.075234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:08.076392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:08.084164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.084850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.085248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] validate_networks() for [('ff83fa46-d09c-4426-9a64-8ad4e2ae8c64', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:04:08.085707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.086043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.126344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa42a2d6-c0e8-46c9-9d9e-ed153d0653e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056881 May 09 10:04:08.127144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 574/1124] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:08.525250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:04:08.525794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:04:08.526377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:04:08.526792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:04:08.527200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:04:08.543622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.543622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.543622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.544005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.567503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for project 39c36cb22c2846e480c26840635bf29c. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:04:08.572273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Getting quotas for user 1c091a71e2ad46ceafe25be874c016a6 and project 39c36cb22c2846e480c26840635bf29c. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:04:08.639981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:04:08.642293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: 390cae6f-c0c2-4d63-9914-57a4d309b6f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d',volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:04:08.665402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:04:08.666435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:08.672756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.673305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.674136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.674586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.707996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Request method failure captured: May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: POST /compute/v2.1/servers HTTP/1.1 May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 476 May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieONX71zCuFMU8WfmrGILrV7NP-SXrBrCKtPu65DQ436-_5EJ18qTqTDVwENBch8xphDMDb2uWO1HzfLjEnJZPiZcuM7IS_z3FefG_mkA4oHW79QnGL0jNi4wB86gAfzFtMW5r5YcOmDU1-Tg7z1WwVeAT3WcjHbK9enECDBonmmr1ec May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:08.711355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_39c36cb22c2846e480c26840635bf29c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 1c091a71e2ad46ceafe25be874c016a6 May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:08.713876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1669500027", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-199242016", "security_groups": [{"name": "tempest-secgroup-smoke-785039601"}], "block_device_mapping_v2": [{"uuid": "0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ff83fa46-d09c-4426-9a64-8ad4e2ae8c64"}]}} May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1669500027', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-199242016', 'security_groups': [{'name': 'tempest-secgroup-smoke-785039601'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d'}], 'networks': [{'uuid': 'ff83fa46-d09c-4426-9a64-8ad4e2ae8c64'}]}}} May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:08.714848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise self.value May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:08.715835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:04:08.717779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise self.value May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 09 10:04:08.719610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return self._create_instance( May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 09 10:04:08.721893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise self.value May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._validate_bdm( May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:08.723976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:08.726752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:08.729201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) May 09 10:04:08.729201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:08.729201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 0df53d93-7f1d-4cc4-8b0a-3667aaf1c86d status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-81c87ff0-6edd-411d-a02a-e68cca44513e) {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:08.729201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-14a596b0-4fab-4cd8-8d57-1df71849d044 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 0.778320 May 09 10:04:08.729201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 551/1125] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:04:07 2022] POST /compute/v2.1/servers => generated 295 bytes in 779 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:04:08.769509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-682f6fe4-8994-445a-931a-f601bb16674a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/action" status: 200 len: 37974 microversion: 2.20 time: 0.107901 May 09 10:04:08.770238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 575/1126] 10.222.0.26 () {62 vars in 1318 bytes} [Mon May 9 10:04:08 2022] POST /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653/action => generated 37974 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 09 10:04:08.944952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:08.946813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:08.955566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.956045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.956849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:08.957343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:08.988704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-86625e79-9bf6-4d6d-b4f0-61ce67c0f57c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047815 May 09 10:04:08.989590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 552/1127] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:09.139842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:09.141321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:09.148366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:09.148854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:09.149631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:09.150058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:09.187211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a90b8096-514e-4773-a2ce-5e484f020b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052384 May 09 10:04:09.188354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 576/1128] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:09.191660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:09.192191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:09.198904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:09.199355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:09.200147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:09.200583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:09.214540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] HTTP exception thrown: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Request method failure captured: May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 HTTP/1.1 May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieONX71zCuFMU8WfmrGILrV7NP-SXrBrCKtPu65DQ436-_5EJ18qTqTDVwENBch8xphDMDb2uWO1HzfLjEnJZPiZcuM7IS_z3FefG_mkA4oHW79QnGL0jNi4wB86gAfzFtMW5r5YcOmDU1-Tg7z1WwVeAT3WcjHbK9enECDBonmmr1ec May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:04:09.216110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_39c36cb22c2846e480c26840635bf29c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 1c091a71e2ad46ceafe25be874c016a6 May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.217781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'f2554f24-99b6-4ba6-91e9-9ec6289fbda0'} May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:09.218697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.220207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:04:09.221738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Returning 404 to user: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:09.221738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a934c2dd-2bc3-4859-9e1f-1761ac48fd07 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 404 len: 111 microversion: 2.1 time: 0.033762 May 09 10:04:09.221738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 553/1129] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:04:09 2022] DELETE /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:04:09.229307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:09.229922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] [instance: f2554f24-99b6-4ba6-91e9-9ec6289fbda0] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:09.236903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:09.237375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:09.238152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:09.238626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:09.252645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] HTTP exception thrown: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Request method failure captured: May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 HTTP/1.1 May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieONX71zCuFMU8WfmrGILrV7NP-SXrBrCKtPu65DQ436-_5EJ18qTqTDVwENBch8xphDMDb2uWO1HzfLjEnJZPiZcuM7IS_z3FefG_mkA4oHW79QnGL0jNi4wB86gAfzFtMW5r5YcOmDU1-Tg7z1WwVeAT3WcjHbK9enECDBonmmr1ec May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:04:09.254353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/39c36cb22c2846e480c26840635bf29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_39c36cb22c2846e480c26840635bf29c", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 39c36cb22c2846e480c26840635bf29c May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestVolumeBootPattern-1492144335 May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 1c091a71e2ad46ceafe25be874c016a6 May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestVolumeBootPattern-1492144335-project May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.255697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'f2554f24-99b6-4ba6-91e9-9ec6289fbda0'} May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:04:09.256491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. May 09 10:04:09.257999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:04:09.259332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Returning 404 to user: Instance f2554f24-99b6-4ba6-91e9-9ec6289fbda0 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:04:09.259332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66407f62-59d7-4351-bded-dcf92af91e29 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0" status: 404 len: 111 microversion: 2.1 time: 0.030690 May 09 10:04:09.259332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 577/1130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:04:09 2022] GET /compute/v2.1/servers/f2554f24-99b6-4ba6-91e9-9ec6289fbda0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:04:10.001407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:10.002332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:10.009519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:10.009969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:10.010722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:10.011153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:10.046249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-866f5996-6464-40bd-a378-fed59a3ef9db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 May 09 10:04:10.047567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 554/1131] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:10.199107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:10.199948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:10.206815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:10.207262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:10.208175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:10.208610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:10.239686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5fa94e3-8de0-4e08-bd9c-63991f3d7127 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 May 09 10:04:10.240228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 578/1132] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:11.058222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:11.059173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:11.065921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:11.066367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:11.067212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:11.067646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:11.097282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe937112-ca5f-43ce-9a5c-432c21c57929 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 May 09 10:04:11.097976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 555/1133] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:11.250679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:11.252242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:11.259193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:11.259672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:11.260441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:11.260923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:11.290706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-047695b9-6ac7-4ea3-a3fc-6a26306af99e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 May 09 10:04:11.291270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 579/1134] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:12.109894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:12.110865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:12.118004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:12.118338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:12.119097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:12.119527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:12.152036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c562fda-c62e-4210-82c7-020d16525989 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 May 09 10:04:12.152647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 556/1135] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:12.302728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:12.303672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:12.310469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:12.310923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:12.311696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:12.312136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:12.341580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-639c8b70-755b-411e-bcf1-c69bf1dd1f10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042954 May 09 10:04:12.342133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 580/1136] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:13.163784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:13.164692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:13.171167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:13.171592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:13.172383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:13.172843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:13.202886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e2b2cad-8c3a-42dc-85a8-8b04175dab13 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 May 09 10:04:13.203676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 557/1137] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:13.353864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:13.354820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:13.361633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:13.362085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:13.362851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:13.363286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:13.392757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11271db3-4cd8-43db-a6b4-64d85b10ce11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 May 09 10:04:13.393307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 581/1138] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:14.214816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:14.215807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:14.222439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:14.222884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:14.223747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:14.224179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:14.257197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a97f3810-6014-47ed-a6e3-b1033669795f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046244 May 09 10:04:14.261542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 558/1139] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:14.404075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:14.405093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:14.411897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:14.412355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:14.413170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:14.413605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:14.444619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e866a020-3845-4f48-8728-7a5bb926d9d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 May 09 10:04:14.445469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 582/1140] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:15.269637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:15.270960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:15.281883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:15.282640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:15.283917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:15.284648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:15.315971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0375dbb2-f60d-4b01-98f4-a8344608dd03 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050516 May 09 10:04:15.316673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 559/1141] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:15.456897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:15.457840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:15.464598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:15.465078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:15.465847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:15.466283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:15.496394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c4b7f06-e983-4fb2-b49f-022ffc55a25b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043648 May 09 10:04:15.496991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 583/1142] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:16.328160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:16.329130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:16.336137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:16.336477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:16.337294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:16.337728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:16.368558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35154c8a-0f04-42ab-8c42-c003c471b369 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044447 May 09 10:04:16.369155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 560/1143] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:16.507886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:16.508836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:16.516391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:16.516884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:16.517653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:16.518078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:16.547875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-55c94043-dc94-431e-9347-f2b67e6d7c66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 May 09 10:04:16.548424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 584/1144] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:17.381247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:17.382193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:17.391778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:17.391778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:17.391778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:17.391778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:17.423093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3fdfa7dd-254b-4d45-a94f-46b0951b8eba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045913 May 09 10:04:17.424035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 561/1145] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:17.561459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:17.562684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:17.571004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:17.571446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:17.572222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:17.572673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:17.603589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44fa6e69-83f0-453e-b2ce-b1682bde6296 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046056 May 09 10:04:17.604130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 585/1146] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:18.435197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:18.436122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:18.442992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:18.443441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:18.444218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:18.444647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:18.476286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-236cddb3-10b2-4a23-8355-8af5a667aee0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045114 May 09 10:04:18.476882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 562/1147] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:18.615864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:18.616794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:18.623916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:18.624356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:18.625179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:18.625608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:18.658003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-288bb769-64ce-406d-b024-e12b07575a4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 May 09 10:04:18.658562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 586/1148] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:19.491254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:19.492244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:19.505239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:19.505693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:19.506516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:19.506948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:19.540977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6ea6b79-bb70-478e-9bf8-3da50eb6df6e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053785 May 09 10:04:19.540977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 563/1149] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:19.670043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:19.670972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:19.678169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:19.678622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:19.679394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:19.679827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:19.711041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0be3ac7f-25dc-41a1-924c-73a468b4abfa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 May 09 10:04:19.711683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 587/1150] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:20.550156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:20.551206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:20.558482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:20.558970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:20.559799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:20.560234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:20.598491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97d97592-9f6f-475d-a542-a0dad3d9bfee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052257 May 09 10:04:20.599098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 564/1151] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:20.723401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:20.724231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:20.731578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:20.732025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:20.732837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:20.733266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:20.766417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d02b9bf3-90c8-4925-a31d-f94707b60ce8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047094 May 09 10:04:20.767010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 588/1152] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:21.610572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:21.611507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:21.618891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:21.619444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:21.620136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:21.620566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:21.657912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee6443ab-874e-4c29-a2a2-372c5ea7c412 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 May 09 10:04:21.658534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 565/1153] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:21.778803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:21.779643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:21.788733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:21.789456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:21.790393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:21.791069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:21.822680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-650a2898-d557-4989-8148-a026cd649259 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047999 May 09 10:04:21.823256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 589/1154] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:22.671275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:22.672176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:22.679199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:22.679657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:22.680516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:22.681207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:22.713904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac09e8f6-2f69-450b-baf9-654e43a9565c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046543 May 09 10:04:22.714375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 566/1155] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:22.834882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:22.835809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:22.842590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:22.843039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:22.843822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:22.844298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:22.876217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d79c3cf-911a-4d18-bffc-69147422a58a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 May 09 10:04:22.876817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 590/1156] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:23.726006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:23.726918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:23.733981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:23.734456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:23.735298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:23.735684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:23.766258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58c53e59-35c8-42db-b211-66c4bfa3982f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 May 09 10:04:23.770678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 567/1157] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:23.888768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:23.889627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:23.896845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:23.897297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:23.898059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:23.898495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:23.933064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15a6e066-5625-49b4-a151-5a8b02bf9423 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048376 May 09 10:04:23.933640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 591/1158] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:24.778829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:24.779755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:24.787411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:24.787890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:24.788923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:24.789129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:24.821224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5cd7d94d-07e2-4334-839b-6b68149b6a78 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 May 09 10:04:24.821830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 568/1159] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:24.945914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:24.946844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:24.953960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:24.954413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:24.955187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:24.955618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:24.988071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6eb1d12a-4e49-4149-b70c-f35bc6ebcaaf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 May 09 10:04:24.988691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 592/1160] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:25.834148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:25.834731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:25.841264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:25.841721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:25.842514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:25.842953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:25.874561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c43d442b-db47-40a4-8c55-a9c91058c813 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045195 May 09 10:04:25.875169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 569/1161] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:26.001205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:26.003760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:26.013043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:26.013498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:26.014318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:26.014742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:26.048299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a76cfab1-464c-47f3-976f-f7a7c777c9cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051136 May 09 10:04:26.048906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 593/1162] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:26.886970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:26.887817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:26.894987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:26.895458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:26.896237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:26.896699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:26.928830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0957fecc-99b5-449f-bbf5-7398c23d6819 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045906 May 09 10:04:26.929421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 570/1163] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:27.060983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:27.061909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:27.068961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:27.069405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:27.070152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:27.070579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:27.102817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8c5b628a-0001-4cd0-b79e-5d86bf806dae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 May 09 10:04:27.103700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 594/1164] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:27.940853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:27.941939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:27.948592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:27.949088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:27.949872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:27.950307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:27.982562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b762e29-eb83-474a-87e3-0ff533010611 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 May 09 10:04:27.983156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 571/1165] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:28.115386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:28.116293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:28.123702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:28.124151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:28.124964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:28.125367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:28.156390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-accb411b-f0bc-47ad-997e-93c40f92eabd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 May 09 10:04:28.157161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 595/1166] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:28.995412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:28.996429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:29.004113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:29.004579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:29.005373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:29.005805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:29.038195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9d2bd50-5a6c-414e-bbb3-fef0e3abd036 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 May 09 10:04:29.039061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 572/1167] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:29.167977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:29.168838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:29.175947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:29.176393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:29.177202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:29.177630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:29.208114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7a3c1b93-3214-461a-833b-45db096d4b1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 May 09 10:04:29.208689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 596/1168] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:30.051135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:30.052082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:30.059134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:30.059636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:30.060422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:30.060911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:30.092645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65540f47-5767-4d3f-94e8-eb9adeda1192 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 May 09 10:04:30.093469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 573/1169] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:30.219955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:30.220833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:30.227896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:30.228653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:30.229465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:30.229899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:30.261350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6f911da-cefa-425e-964d-2bd2c4ab3a43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 May 09 10:04:30.261897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 597/1170] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:31.105216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:31.106117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:31.112982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:31.113433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:31.114404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:31.115005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:31.148420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9181aff6-0026-40de-ad12-c27b68929e1b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047587 May 09 10:04:31.149118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 574/1171] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:31.273739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:31.274608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:31.281961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:31.282421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:31.283204 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:31.283668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:31.319894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb70278d-08c8-43f9-a5b5-447109b1deb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050407 May 09 10:04:31.320470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 598/1172] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:32.162089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:32.163396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:32.171459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:32.171910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:32.172742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:32.173187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:32.207448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a0e307d-2639-45bd-9325-81b551274e62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050217 May 09 10:04:32.208032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 575/1173] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:32.331991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:32.333318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:32.341136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:32.341593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:32.342389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:32.342829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:32.374220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-392030b0-40ba-49e5-9b13-48a1860bcd57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046196 May 09 10:04:32.374788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 599/1174] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:33.219799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:33.220924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:33.228762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:33.229217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:33.230002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:33.230436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:33.262450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-519cd6c5-ce5c-4151-8f5e-6322dd0ceb2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046664 May 09 10:04:33.263053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 576/1175] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:33.386245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:33.387072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:33.393898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:33.394477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:33.395449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:33.395915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:33.429580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f9eedd6-944c-48a0-aec0-769b06fd0398 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 May 09 10:04:33.430184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 600/1176] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:34.278066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:34.279378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:34.289796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:34.290545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:34.291791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:34.292511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:34.329614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7404539c-ded2-4bf0-96f6-6ab2dbafbc62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058111 May 09 10:04:34.330209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 577/1177] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:34.444377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:34.445350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:34.455653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:34.456262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:34.457465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:34.457892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:34.490011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41c81462-e136-4a0b-bcb8-782a9cada7f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051875 May 09 10:04:34.490601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 601/1178] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:35.342282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:35.343228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:35.355841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:35.356291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:35.358523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:35.359046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:35.391368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-518fd971-7350-42d6-8ee6-7c7c92577c84 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053149 May 09 10:04:35.392235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 578/1179] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:35.501996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:35.503089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:35.513376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:35.513936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:35.514715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:35.515158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:35.548268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df004f0e-557f-4355-ad40-2b13cfee9505 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050267 May 09 10:04:35.549103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 602/1180] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:36.407921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:36.408902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:36.416967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:36.417428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:36.418215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:36.418631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:36.450231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e3a03c0-4794-4cd8-8c81-e34b5e5fa68a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049376 May 09 10:04:36.454138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 579/1181] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:36.559934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:36.561571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:36.568756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:36.569360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:36.570252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:36.570721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:36.602213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb636a1a-c064-428f-8527-ecde440d093e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 May 09 10:04:36.602804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 603/1182] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:37.462544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:37.463482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:37.470673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:37.471183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:37.471963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:37.472482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:37.506176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a0a4b480-b6dd-4b69-bc69-2b4606a671fc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 May 09 10:04:37.506807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 580/1183] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:37.614911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:37.615750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:37.622801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:37.623248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:37.624022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:37.624455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:37.655494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-319ffdd4-18bf-4667-b42c-8d8dab63c808 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 May 09 10:04:37.656055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 604/1184] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:38.518461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:38.519436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:38.526410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:38.526868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:38.527655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:38.528098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:38.560491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d296e65-ae62-4c93-ac87-ab5f72067daa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 May 09 10:04:38.561317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 581/1185] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:38.667788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:38.668922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:38.678949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:38.679513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:38.680722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:38.681339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:38.714758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2d33635-f5ec-4124-a4d2-7027bcbe0816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051121 May 09 10:04:38.715328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 605/1186] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:39.577706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:39.578629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:39.585704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:39.586141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:39.586956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:39.587387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:39.627540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1228801-86b1-4750-ab02-8c88d4e4cd1a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053576 May 09 10:04:39.628426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 582/1187] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:39.727308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:39.728474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:39.736126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:39.736718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:39.737936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:39.738513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:39.776175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf9eaa05-c2a9-46b1-86d5-460e3457d98c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052915 May 09 10:04:39.776782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 606/1188] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:40.640148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:40.641103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:40.648578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:40.649057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:40.649834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:40.650336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:40.681824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8764b269-4d13-4e93-b1a0-0e53f9a280d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 May 09 10:04:40.682405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 583/1189] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:40.788034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:40.789278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:40.796538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:40.797008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:40.797786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:40.798217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:40.829666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45d8c2d3-ce6a-46b3-8ba7-ce2bc26036a4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 May 09 10:04:40.830234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 607/1190] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:41.694074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:41.695001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:41.705049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:41.705656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:41.706786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:41.707420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:41.743853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ff9cdf9-ac44-4a3c-9919-ea4fe9bc2659 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053769 May 09 10:04:41.744485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 584/1191] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:41.841744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:41.842607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:41.849761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:41.850208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:41.850989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:41.851421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:41.882675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-93abf17e-9f0b-4b49-b316-5ea2a814cd97 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 May 09 10:04:41.883264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 608/1192] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:42.758985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:42.760059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:42.768239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:42.768937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:42.769909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:42.770378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:42.804081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc76bc96-f615-4e23-a7ef-2e8151861013 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051781 May 09 10:04:42.804650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 585/1193] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:42.894919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:42.895838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:42.903268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:42.903708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:42.904480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:42.904945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:42.935687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c573529-02a7-4741-b3db-4d9972b2c7d3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 May 09 10:04:42.936255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 609/1194] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:43.816523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:43.817521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:43.824366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:43.824840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:43.825621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:43.826059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:43.859038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3794e229-a340-4eab-9fa7-fbad01928e2b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046703 May 09 10:04:43.859620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 586/1195] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:43.947639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:43.948551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:43.957075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:43.957725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:43.958886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:43.959435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:43.991286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39a08eb1-ddbd-483e-82bf-8d569d76603d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047638 May 09 10:04:43.991851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 610/1196] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:44.871319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:44.872262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:44.879352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:44.879807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:44.880613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:44.881086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:44.912410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2c5508b-cdd7-4c77-9b59-da596d64b5de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 May 09 10:04:44.912952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 587/1197] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:45.003282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:45.004238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:45.011702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:45.012153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:45.013044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:45.013474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:45.045899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0089bb2-d490-43cb-9c8a-09e6c3b76418 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 May 09 10:04:45.046479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 611/1198] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:45.924703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:45.925639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:45.933632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:45.933632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:45.934099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:45.934504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:45.973507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c3eeb40-efed-4a66-8349-801aa2d17faf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052747 May 09 10:04:45.974176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 588/1199] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:46.058050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:46.058973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:46.065633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:46.066194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:46.067012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:46.067392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:46.097220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1a70203-de97-4a3b-a26b-07233625f216 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 May 09 10:04:46.097815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 612/1200] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:46.988198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:46.989074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:46.996262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:46.996698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:46.997521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:46.997950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:47.030281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c50574d-44b3-4bec-9e45-ac9520e384d5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 May 09 10:04:47.030841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 589/1201] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:47.109727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:47.110645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:47.117398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:47.117840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:47.118616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:47.119048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:47.149087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7fb877ec-7f55-4a7e-a9ff-e5fd41471072 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043231 May 09 10:04:47.149654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 613/1202] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:48.044473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:48.045430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:48.053129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:48.053727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:48.054869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:48.055516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:48.085148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-276ca3cd-29ee-494c-b3ee-d96ebb7d8501 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 May 09 10:04:48.085938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 590/1203] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:48.160965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:48.161902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:48.168445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:48.168921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:48.169687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:48.170114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:48.199497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64fb45dc-515a-41c8-958e-15f5a409f2de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 May 09 10:04:48.200053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 614/1204] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:49.098603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:49.099587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:49.106811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:49.107274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:49.108055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:49.108469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:49.138922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb30f614-0538-43ca-a579-3c5a91ea79b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044375 May 09 10:04:49.139480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 591/1205] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:49.211014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:49.211950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:49.218576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:49.219030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:49.219808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:49.220247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:49.251061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9825c209-58b9-4f4e-b096-f20a355c0c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 May 09 10:04:49.251629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 615/1206] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:50.150669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:50.151590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:50.158176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:50.158629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:50.159396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:50.159882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:50.191250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51a44411-e2e0-4811-b5a4-754d644d61b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 May 09 10:04:50.192045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 592/1207] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:50.263418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:50.264356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:50.271044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:50.271496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:50.272272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:50.272738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:50.303362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-511ccb74-3c87-4e51-822d-d5f82a1ea916 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044192 May 09 10:04:50.303936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 616/1208] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:51.203238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:51.204070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:51.210879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:51.211332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:51.212209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:51.212644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:51.243861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1bdb13a9-1b41-47dc-8965-3b7d965ef71c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 May 09 10:04:51.244482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 593/1209] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:51.315212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:51.316229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:51.323402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:51.323851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:51.324629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:51.325100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:51.355387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a52dc56-c3e5-4438-a451-f29eeab4b806 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 May 09 10:04:51.355948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 617/1210] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:52.256058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:52.256937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:52.263506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:52.263955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:52.264737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:52.265169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:52.295843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4420d5c4-0411-4a9b-87ce-cdc20dced263 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 May 09 10:04:52.296499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 594/1211] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:52.367465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:52.368536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:52.375364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:52.375862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:52.376709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:52.377192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:52.407651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf5d3323-2467-4344-b518-782d7e7ac099 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 May 09 10:04:52.408248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 618/1212] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:53.308635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:53.309580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:53.316426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:53.316914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:53.317682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:53.318121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:53.352395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3141629f-c9c7-420e-a8d7-a175ea58f7f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047717 May 09 10:04:53.353337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 595/1213] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:53.419759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:53.420723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:53.427016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:53.427311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:53.428187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:53.428630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:53.458999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94ad498b-1962-4cbd-8fab-8ed7e9b7a544 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 May 09 10:04:53.459593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 619/1214] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:54.365139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:54.366040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:54.373298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:54.373755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:54.374528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:54.374965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:54.406259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-249cc9c6-d1aa-4abd-9852-8a65d880e329 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 May 09 10:04:54.406838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 596/1215] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:54.470686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:54.473239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:54.478575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:54.479025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:54.479794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:54.480229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:54.510568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fcc74f2d-c7d6-4ac5-85fb-4497ae175d7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 May 09 10:04:54.511276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 620/1216] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:55.418502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:55.419463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:55.426684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:55.427118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:55.427909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:55.428341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:55.462291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-abef91b8-d8bb-4e10-ac5d-4fec15912563 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047753 May 09 10:04:55.462873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 597/1217] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:55.523553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:55.523553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:55.530237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:55.530713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:55.531498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:55.531928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:55.576897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f8f3e88-3e63-4592-bf11-a4ec613e0d67 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 May 09 10:04:55.576897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 621/1218] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:56.473737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:56.474656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:56.481596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:56.482040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:56.482829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:56.483230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:56.512640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4fc15d19-47d8-4491-bf9d-918adbc985e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043024 May 09 10:04:56.513234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 598/1219] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:56.581307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:56.582213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:56.589370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:56.589635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:56.590395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:56.590821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:56.622032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f4d11b8-50c4-45ba-b438-1ea343f99638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 May 09 10:04:56.622595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 622/1220] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:57.523960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:57.524962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:57.531872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:57.532326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:57.533162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:57.533623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:57.565065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3596b5b4-716c-4be0-b625-e0d3d69e059c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 May 09 10:04:57.568986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 599/1221] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:57.634062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:57.634998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:57.641808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:57.642266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:57.643039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:57.643471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:57.675278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac91820c-9515-46bf-9da2-5a3511ea6b10 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 May 09 10:04:57.675846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 623/1222] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:58.577258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:58.578179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:58.584978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:58.585426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:58.586185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:58.586617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:58.615771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-428a984d-5c1e-4afa-9ea7-c915d08bfbad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042490 May 09 10:04:58.616321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 600/1223] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:58.687252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:58.688188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:58.694769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:58.695263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:58.696137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:58.696578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:58.726610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f07785c-8a41-464f-aedd-17f1a2cca647 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 May 09 10:04:58.727196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 624/1224] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:59.627747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:59.628820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:59.635675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:59.636123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:59.636897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:59.637323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:59.667230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97bd646a-9017-404b-bc89-7f88ce2bc835 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 May 09 10:04:59.667791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 601/1225] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:04:59.738704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:04:59.739856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:04:59.746199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:59.746727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:59.747556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:04:59.748051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:04:59.778939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca6d053f-a3ba-43f2-a3d0-860884d253d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 May 09 10:04:59.780730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 625/1226] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:04:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:00.679385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:00.680374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:00.687252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:00.687710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:00.688500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:00.688968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:00.718523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2d5869a-c801-453f-8ebe-254bd6b01d67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043246 May 09 10:05:00.719089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 602/1227] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:00.790724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:00.791951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:00.798742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:00.799283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:00.800284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:00.800735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:00.830560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-196a7064-52f2-4cc4-86c0-d1d6b25bb1ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 May 09 10:05:00.831034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 626/1228] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:01.731584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:01.732533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:01.739543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:01.740004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:01.740822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:01.741264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:01.771213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b1ee9bf6-78a2-4b77-ae5d-a4b810623293 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 May 09 10:05:01.771782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 603/1229] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:01.842804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:01.843724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:01.850633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:01.851081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:01.851863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:01.852297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:01.883146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72c9f47e-a80e-4017-96fe-4078c25bdcec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 May 09 10:05:01.883746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 627/1230] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:02.783629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:02.784560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:02.791914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:02.792359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:02.793193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:02.793632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:02.826884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ddbd449-e2a4-46e3-b272-44f17c283aca tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 May 09 10:05:02.827395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 604/1231] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:02.895259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:02.896369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:02.904272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:02.904873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:02.905857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:02.906425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:02.943314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9dc0e1e-e55d-4a32-ac3c-f71e0bc510a1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052048 May 09 10:05:02.943680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 628/1232] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:03.954982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:03.955944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:03.957631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:03.958543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:03.962912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:03.963436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:03.964284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:03.965052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:03.965491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:03.965938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:03.966905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:03.967805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:03.996115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0226a332-a57c-40ec-9969-fb8e597602ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 May 09 10:05:03.999901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 629/1233] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:04.005710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d0219936-b533-4fca-ad37-efceba45aee1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170978 May 09 10:05:04.006337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 605/1234] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:05.007616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:05.008596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:05.015272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:05.015723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:05.016514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:05.016963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:05.017600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:05.018671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:05.025282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:05.025730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:05.026503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:05.026913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:05.050819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3803f793-6443-417c-b7db-f4db7317f1f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047166 May 09 10:05:05.051599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 630/1235] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:05.057212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee1e2b16-6d0c-47b7-b38f-e5eb8a0d6e70 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 May 09 10:05:05.057781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 606/1236] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:06.061957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:06.063058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:06.068503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:06.069432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:06.069600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:06.069839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:06.070829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:06.071248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:06.076531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:06.076978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:06.077983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:06.078413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:06.104595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f912f161-70c5-46a6-9f5d-aa1e1f1a139f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 May 09 10:05:06.105198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 631/1237] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:06.108472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13302b57-b393-4d3f-ad29-f0a7faad5349 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 May 09 10:05:06.109038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 607/1238] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:07.115643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:07.116550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:07.119676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:07.120694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:07.124543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:07.125034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:07.125844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:07.126256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:07.127109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:07.127547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:07.128391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:07.128878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:07.157571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7da5bb96-8707-4e4b-9772-b473d9b4ae4d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 May 09 10:05:07.157943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3ba42c58-5423-4491-b9b0-2ff3504e6104 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 May 09 10:05:07.161718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 632/1239] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:07.161907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 608/1240] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:08.169452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:08.169990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:08.170339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:08.170634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:08.177122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:08.177323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:08.177547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:08.177712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:08.178494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:08.178894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:08.179002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:08.179330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:08.209622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbcdac92-2ebb-486a-a92e-c0d5d9a9a420 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 May 09 10:05:08.210183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 609/1241] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:08.210872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b8b7a1f9-b81b-4bce-bf21-a3af1d7846db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045377 May 09 10:05:08.211419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 633/1242] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:09.221734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:09.222587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:09.223015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:09.223511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:09.230822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:09.231113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:09.231358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:09.231853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:09.232101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:09.232549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:09.233138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:09.233752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:09.263712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0754142a-1a38-435f-b607-aea299f5be8f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046399 May 09 10:05:09.264305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 610/1243] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:09.267840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8c86c6ce-be17-453a-a97a-d450b015f871 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049502 May 09 10:05:09.268414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 634/1244] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:10.275549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:10.276601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:10.279757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:10.281435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:10.283737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:10.284208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:10.285035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:10.285479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:10.288102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:10.288771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:10.289747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:10.290185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:10.318674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c8173e9-b9d3-403e-89b5-764f9c0e6805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 May 09 10:05:10.319262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 611/1245] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:10.320862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d9516ff1-30c0-4efb-a843-e7d6c57d9187 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 May 09 10:05:10.321440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 635/1246] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:11.330458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:11.331441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:11.331891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:11.332359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:11.338086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:11.338614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:11.338836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:11.339284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:11.339430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:11.339878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:11.340040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:11.340684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:11.370241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44837aeb-75ad-42f2-b63a-110e34c63eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 May 09 10:05:11.370752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b643c74f-74dc-4fa5-a315-082b2e2e33fa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 May 09 10:05:11.371090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 612/1247] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:11.374487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 636/1248] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:12.382002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:12.382944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:12.386779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:12.387830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:12.389765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:12.390259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:12.391172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:12.391594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:12.394414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:12.394865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:12.395660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:12.396094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:12.423073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70076fc9-e12d-4001-8adb-30f8a3b1db36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 May 09 10:05:12.423657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 613/1249] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:12.434682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6afe16a8-45e2-4d98-b365-10dbedb1562e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053196 May 09 10:05:12.435318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 637/1250] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:13.435036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:13.435970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:13.443738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:13.444198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:13.445059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:13.445494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:13.450629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:13.451660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:13.461871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:13.462471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:13.463268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:13.463774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:13.476684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-697d8d8d-0b21-4efb-8e8a-db9fa258de89 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 May 09 10:05:13.477565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 614/1251] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:13.494818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5039ac7e-af42-4fde-8050-d4bb05c175be tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052258 May 09 10:05:13.495396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 638/1252] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:14.488458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:14.489705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:14.496610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:14.497132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:14.497899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:14.498354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:14.506635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:14.508386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:14.514740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:14.515248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:14.516090 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:14.516593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:14.529955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ffd870c-eb9e-4a11-a575-348b2fa84972 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 May 09 10:05:14.530501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 615/1253] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:14.550270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-553b823e-7f9d-4e39-8781-8b95c00e66b3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047684 May 09 10:05:14.550852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 639/1254] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:15.541884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:15.542835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:15.549696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:15.550173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:15.550957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:15.551388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:15.562192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:15.563426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:15.570258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:15.570805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:15.571649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:15.572169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:15.582658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-23fe0742-1555-4ae4-8724-d5d721e843fc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044774 May 09 10:05:15.583230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 616/1255] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:15.606525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c55c6de-08ee-4d5f-aa3a-1743f561ae71 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048383 May 09 10:05:15.607103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 640/1256] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:16.594245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:16.595172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:16.601764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:16.602210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:16.603262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:16.603727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:16.619065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:16.619988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:16.626754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:16.627205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:16.628125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:16.628554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:16.633209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fd2c87c-9dd8-4c2f-ae17-39b023d63122 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042837 May 09 10:05:16.633752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 617/1257] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:16.658614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-26325f2f-de04-4118-a23e-eee6f4225245 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044214 May 09 10:05:16.659326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 641/1258] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:17.646777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:17.646777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:17.652568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:17.653039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:17.653809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:17.654238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:17.669622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:17.670568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:17.677281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:17.678186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:17.678945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:17.679406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:17.688612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7830e37-65ef-4502-a850-a68005425d39 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047634 May 09 10:05:17.689410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 618/1259] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:17.718624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0962784-bbe9-4dd5-8852-1683dcbca84a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052886 May 09 10:05:17.719183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 642/1260] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:18.699764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:18.700715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:18.707617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:18.708072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:18.708892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:18.709329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:18.730960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:18.732634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:18.740245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:18.741100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:18.741955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:18.742752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:18.743483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b175506-a5de-4dbf-ac17-34d8c04be77e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047377 May 09 10:05:18.746927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 619/1261] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:18.773290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b28695c-01f0-4ae7-b4e7-eb458468ac9e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046491 May 09 10:05:18.773858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 643/1262] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:19.755801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:19.756882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:19.763550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:19.763998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:19.764894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:19.765335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:19.785699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:19.786903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:19.797643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:19.798313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:19.799690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:19.800355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:19.801512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4a5fbf4-1e08-46f0-be8b-c460b55ab747 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049859 May 09 10:05:19.802153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 620/1263] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:19.834764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fba076e8-2b40-4ef1-8852-c92e46596dc2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053105 May 09 10:05:19.835368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 644/1264] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:20.813722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:20.814709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:20.821689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:20.822142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:20.822917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:20.823353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:20.846705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:20.847601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:20.854710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:20.855161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:20.855934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:20.856257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c3bd93f-b2ee-4939-8b68-f642c57a3f36 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046654 May 09 10:05:20.856548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:20.857125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 621/1265] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:20.889246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7fd55cf-1de6-4070-9e74-16e9cdaf5e88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046408 May 09 10:05:20.889822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 645/1266] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:21.868001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:21.868991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:21.875980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:21.876435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:21.877352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:21.877913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:21.901964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:21.902882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:21.909490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:21.909943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:21.910734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:21.911203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:21.913899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59c3ae55-2fd6-4cbe-b055-dfe2adfdc562 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049819 May 09 10:05:21.917736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 622/1267] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:21.940625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a686b55-5af0-4e91-a284-38b50e34e27c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 May 09 10:05:21.941212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 646/1268] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:22.925809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:22.926741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:22.933606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:22.934062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:22.934832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:22.935267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:22.951550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:22.952465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:22.959581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:22.960427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:22.961300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:22.961848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:22.965847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9fedeaea-0d4e-475a-8b14-c9993ddb7cf2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 May 09 10:05:22.966450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 623/1269] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:22.995593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3faf2a48-3c6b-4a94-b651-15cbefb1386a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048003 May 09 10:05:22.996322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 647/1270] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:23.978413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:23.979367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:23.986302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:23.986761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:23.987616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:23.988055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:24.012355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:24.013316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:24.019798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:24.020246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:24.021093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-930ab59b-902e-4d2b-af70-275f8fd5121f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 May 09 10:05:24.021260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:24.021729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:24.021842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 624/1271] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:24.053865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e61073c7-bbeb-4b3f-aa55-5fb1fde6781f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046278 May 09 10:05:24.054437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 648/1272] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:25.032785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:25.033800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:25.040500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:25.041010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:25.041740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:25.042353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:25.065634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:25.066557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:25.072982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:25.073425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:25.074055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c2f0024-a33a-481e-89ee-40c9cc82911d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 May 09 10:05:25.074172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:25.074565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:25.074700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 625/1273] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:25.104391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-68464a1b-46b2-42f9-aa03-44dd24dd265a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042733 May 09 10:05:25.104974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 649/1274] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:26.086007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:26.086916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:26.093505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:26.093950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:26.094723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:26.095156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:26.116064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:26.118005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:26.124971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:26.125164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:26.125791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:26.126232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:26.128007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7623d9cf-3e34-46d3-986a-b6dd5c6d8bae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044579 May 09 10:05:26.128007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 626/1275] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:26.155854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b88b514-c084-434a-aa30-24b8da9376ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 May 09 10:05:26.156425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 650/1276] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:27.138908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:27.139899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:27.146884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:27.147336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:27.148119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:27.148548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:27.169311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:27.170611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:27.177557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:27.178135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:27.178695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:27.179246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:27.187019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de6cb50b-7a77-41bb-9ce4-bf97b6056bf3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052118 May 09 10:05:27.187791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 627/1277] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:27.211536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac3304f1-3366-47fc-9820-b6e492881061 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047547 May 09 10:05:27.212126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 651/1278] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:28.199030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:28.199958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:28.206669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:28.207119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:28.207895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:28.208332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:28.223460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:28.224385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:28.231575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:28.232021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:28.232869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:28.233306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:28.240731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c170f8b3-e13b-43ca-9b7a-90ebc2fea7bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 May 09 10:05:28.244445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 628/1279] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:28.262965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-130bd96e-1cd2-4d30-b6ed-7352126a96e2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043454 May 09 10:05:28.263501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 652/1280] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:29.251729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:29.252681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:29.259551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:29.260019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:29.260856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:29.261316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:29.274761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:29.275678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:29.282513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:29.282967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:29.283799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:29.284266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:29.293762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-479788dc-26dd-4e1c-90b8-389af1f4f653 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 May 09 10:05:29.297548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 629/1281] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:29.314502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dc16c9f7-34d5-42d5-973c-c1174039116c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 May 09 10:05:29.315146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 653/1282] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:30.305209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:30.306168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:30.312963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:30.313477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:30.314263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:30.314701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:30.327869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:30.328976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:30.336358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:30.336836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:30.337604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:30.338029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:30.345328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f0335ac-961a-4b33-b535-2773968ab3f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 May 09 10:05:30.348328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 630/1283] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:30.367892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d0a760e9-853e-464f-8197-5ca56160e564 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 May 09 10:05:30.368474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 654/1284] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:31.357736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:31.358656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:31.365473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:31.365924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:31.366693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:31.367123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:31.379865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:31.381217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:31.390482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:31.390943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:31.391760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:31.392173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:31.401011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-30134a23-918f-4c57-88da-e8f8235a63c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047138 May 09 10:05:31.401778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 631/1285] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:31.428280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa7ac0d5-2a1c-4a15-9ebe-de2c59b15db3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052416 May 09 10:05:31.428868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 655/1286] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:32.413088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:32.414023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:32.420599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:32.421891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:32.422794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:32.423237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:32.439675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:32.442485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:32.449446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:32.450096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:32.451036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:32.451834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:32.458038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7027bc8f-7e3f-489e-9942-0ddf1c08c516 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049138 May 09 10:05:32.458960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 632/1287] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:32.486792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4e44e3fb-ae64-491c-b4cc-695605d00e1f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051167 May 09 10:05:32.491757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 656/1288] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:33.469674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:33.470629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:33.477559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:33.478318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:33.479086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:33.479515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:33.500685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:33.501724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:33.509025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:33.509566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:33.510428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:33.511009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:33.511262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7bdf465-f3ff-4dfb-b146-d96f2ed7a366 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045663 May 09 10:05:33.512084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 633/1289] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:33.542233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-59fd5370-40d8-4f37-90e2-586ddfad3e16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047522 May 09 10:05:33.542802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 657/1290] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:34.523244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:34.524179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:34.531173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:34.531617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:34.532390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:34.532850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:34.559493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:34.562341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:34.566223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8f9a2d2b-2bb7-454f-b9d9-13670473b4c9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 May 09 10:05:34.567347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 634/1291] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:34.572944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:34.573410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:34.574187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:34.574617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:34.606141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-75e73826-a4c0-43ff-84df-8669e86460bf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050803 May 09 10:05:34.606715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 658/1292] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:35.579854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:35.580799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:35.589942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:35.590726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:35.591576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:35.592010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:35.617818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:35.618787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:35.624791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-210f0a6b-c48f-481a-9552-f336dc543c56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050047 May 09 10:05:35.625695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 635/1293] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:35.631888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:35.632341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:35.633352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:35.634002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:35.666009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2196d52e-532a-47de-8aee-7f80f49115d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052128 May 09 10:05:35.666763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 659/1294] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:36.636710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:36.637664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:36.644479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:36.644971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:36.645747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:36.646179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:36.676509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5b444bb4-1675-4468-b800-6e5911681ee9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043695 May 09 10:05:36.677235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 636/1295] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:36.677400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:36.678374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:36.685236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:36.685684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:36.686473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:36.686904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:36.717985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b57f1b0b-48d4-4235-b1d5-2675aca53821 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 May 09 10:05:36.718537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 660/1296] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:37.687767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:37.688694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:37.695510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:37.695986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:37.696805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:37.697244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:37.727502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b39fa88-0092-44d0-8698-415ce2ab2abd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 May 09 10:05:37.728381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 637/1297] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:37.733865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:37.735651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:37.742732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:37.743258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:37.744103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:37.744720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:37.773769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81960692-272f-4a3a-8c61-8835c9b447a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048046 May 09 10:05:37.774324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 661/1298] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:38.739367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:38.740295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:38.747334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:38.747786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:38.748559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:38.749034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:38.778816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1bdcf7d-3853-4792-90ef-cbe5406ae5fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 May 09 10:05:38.779390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 638/1299] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:38.788402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:38.789389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:38.795845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:38.796328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:38.797147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:38.797591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:38.829640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f65b28c-f94d-420d-9738-838cbd6c34b4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 May 09 10:05:38.830573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 662/1300] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:39.791244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:39.792166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:39.798511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:39.798949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:39.799885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:39.800359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:39.830588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5faae6d2-a400-4e19-bcb5-87861f2f8bb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 May 09 10:05:39.831075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 639/1301] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:39.841427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:39.842351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:39.848515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:39.849174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:39.849945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:39.850382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:39.879779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2344edf2-8cc4-4512-ad47-ee44b3bf7358 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042214 May 09 10:05:39.880334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 663/1302] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:40.401933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:05:40.402320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:05:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:05:40.841940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:40.842996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:40.849909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:40.850375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:40.851176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:40.851755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:40.887441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb9b1e1c-019f-4065-a9af-473f9e03ceaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049958 May 09 10:05:40.891320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 640/1303] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:40.891771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:40.892257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:40.899407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:40.899895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:40.900689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:40.901131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:40.930109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c39a1aaf-5e69-4844-b265-8201260608c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 May 09 10:05:40.930671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 664/1304] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:41.899114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:41.900064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:41.906536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:41.906979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:41.907728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:41.908155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:41.936825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8f7f15e1-3762-4aa3-ba8d-764d9f11f26d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 May 09 10:05:41.937561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 641/1305] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:41.941654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:41.942581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:41.949299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:41.949749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:41.950522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:41.950957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:41.981305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-55076431-0823-461c-97e5-86cf425c6069 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 May 09 10:05:41.981865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 665/1306] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:42.947973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:42.948950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:42.955350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:42.955789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:42.956586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:42.957051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:42.986458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22c89a5d-6b9f-42df-a4f5-3826e7849bed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042512 May 09 10:05:42.987807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 642/1307] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:42.992918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:42.993834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:43.000492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:43.000977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:43.001746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:43.002218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:43.030725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c2140f5-f7cd-461d-abd2-af52156b776e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041789 May 09 10:05:43.031288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 666/1308] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:44.000295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:44.001844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:44.008548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:44.009012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:44.009812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:44.010249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:44.040773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65aec0ce-fc91-47bd-bcb7-423f53be5219 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 May 09 10:05:44.040980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 643/1309] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:44.042783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:44.043964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:44.050663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:44.051115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:44.051887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:44.052321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:44.081851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57974caf-e920-4625-89e6-064d7b9694df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043166 May 09 10:05:44.082419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 667/1310] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:45.029948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:05:45.030535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:05:45.051412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:45.052338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:45.058762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:45.059207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:45.059972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:45.060400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:45.089877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-034eae02-cecd-4fc8-909d-98223df539e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042411 May 09 10:05:45.091988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 644/1311] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:45.097146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:45.098082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:45.105111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:45.105628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:45.106383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:45.106815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:45.136605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-007e4c24-ab11-4449-9a3d-a46dabee2911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047126 May 09 10:05:45.137304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 668/1312] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:46.101940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:46.102869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:46.109723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:46.110175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:46.110952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:46.111386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:46.143319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83e7497a-4255-46f4-a7b2-a9767ae9f809 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 May 09 10:05:46.143884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 645/1313] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:46.150978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:46.152358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:46.159353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:46.159810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:46.160588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:46.161072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:46.192330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e740cda6-c437-4304-98bf-ddd3e72744b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047406 May 09 10:05:46.193235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 669/1314] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:47.155428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:47.156514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:47.164859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:47.165329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:47.166107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:47.166540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:47.203423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7ae7fc35-5744-4015-b06b-a831b1e241f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047253 May 09 10:05:47.203423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 646/1315] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:47.204233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:47.205865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:47.213170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:47.213674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:47.214849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:47.215346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:47.247597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed9095d2-fb3b-4ad2-9fc9-a2a7f2d208dc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047470 May 09 10:05:47.248154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 670/1316] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:48.211504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:48.212738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:48.219116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:48.219569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:48.220351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:48.220989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:48.251119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5cc08796-c96e-4dff-8126-3728c2c68eec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 May 09 10:05:48.251696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 647/1317] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:48.260920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:48.261871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:48.269073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:48.269477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:48.270295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:48.270738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:48.306965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23c61c1f-bcef-403f-9be8-fc4731db13ab tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046724 May 09 10:05:48.306965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 671/1318] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:49.263323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:49.264258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:49.271158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:49.271620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:49.272377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:49.272849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:49.302728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a3335a9-a60f-4383-b4fc-65e6a30b925e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 May 09 10:05:49.303307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 648/1319] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:49.315645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:49.316499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:49.323243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:49.323686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:49.324516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:49.324981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:49.356590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-964f5cbc-b388-4660-bf82-a71b2204ff11 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 May 09 10:05:49.357192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 672/1320] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:50.314298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:50.315217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:50.321991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:50.322441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:50.323217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:50.323649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:50.355242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1b24cd3e-743c-4b46-ac2b-9765c58a93c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 May 09 10:05:50.356054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 649/1321] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:50.368276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:50.369246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:50.376161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:50.376614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:50.377582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:50.378053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:50.410772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aba6800c-a9ec-4bae-8f0a-3c9c9b228c1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046397 May 09 10:05:50.411331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 673/1322] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:51.367123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:51.368055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:51.374832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:51.375284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:51.376055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:51.376490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:51.408178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02b63e78-1ff6-4e92-996c-1d298342ae60 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045002 May 09 10:05:51.408843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 650/1323] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:05:51.422794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:51.423948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:51.430646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:51.431138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:51.432130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:51.432649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:51.463294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cba5d305-5b14-445c-8f45-8a0f24d661c4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 May 09 10:05:51.463881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 674/1324] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:51.906040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:05:51.906040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:05:52.420303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:52.421290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:52.428158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:52.428608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:52.429446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:52.430055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:52.461105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a670efc-4602-4f44-86e4-9f351aeb9379 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 May 09 10:05:52.461677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 651/1325] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:52.474809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:52.475773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:52.482753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:52.483196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:52.483959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:52.484393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:52.516736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de2a4b9a-49ae-4632-804f-a51bb144646c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 May 09 10:05:52.517391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 675/1326] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:53.473486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:53.474557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:53.481992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:53.482482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:53.483327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:53.483777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:53.516803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c040b2c6-c13a-4067-b5e4-db1126505200 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 May 09 10:05:53.517598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 652/1327] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:53.527874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:53.528891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:53.535546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:53.536093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:53.537094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:53.537747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:53.571317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ad232d1-c90a-47b6-9409-b4e6838c0789 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 May 09 10:05:53.572071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 676/1328] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:54.529123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:54.530175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:54.537328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:54.537786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:54.538559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:54.538987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:54.570848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1afcb372-392f-4917-9d4c-23bf5c08b05a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045717 May 09 10:05:54.571415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 653/1329] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:54.583388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:54.584313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:54.590749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:54.591202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:54.591972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:54.592408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:54.629834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e877885-bea1-49d0-9c95-e1c1fd362042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050594 May 09 10:05:54.630437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 677/1330] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:55.582995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:55.583917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:55.590729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:55.591180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:55.591946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:55.592375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:55.624112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-deac0110-eae4-42c9-ae8d-85edc9981196 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 May 09 10:05:55.624922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 654/1331] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:55.641709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:55.642822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:55.649336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:55.649793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:55.650549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:55.650970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:55.681802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3653a2cc-6b88-4720-8a2c-5cdf44916781 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 May 09 10:05:55.682430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 678/1332] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:56.635748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:56.636696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:56.643520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:56.643969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:56.644750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:56.645185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:56.676604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca56c566-784d-4938-89e8-cad90ef6f6ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044841 May 09 10:05:56.677232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 655/1333] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:56.693458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:56.694377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:56.701229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:56.701698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:56.702503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:56.702936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:56.733864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-27ea76d5-bc05-4a08-8852-720608d3a94d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 May 09 10:05:56.734441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 679/1334] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:57.688552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:57.689493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:57.696347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:57.696826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:57.697585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:57.698011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:57.727636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-db5187be-2476-4bc8-8559-97c08e826d3d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 May 09 10:05:57.728533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 656/1335] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:57.746349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:57.747404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:57.754373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:57.754821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:57.755606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:57.756050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:57.787270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-370ac094-5ec9-4bbf-b78c-aed5e60177a3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 May 09 10:05:57.787834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 680/1336] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:58.739981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:58.740955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:58.747758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:58.748208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:58.749006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:58.749438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:58.779856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e74743b-0442-494f-83dc-a1d1a1637982 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043913 May 09 10:05:58.780428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 657/1337] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:58.799616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:58.800552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:58.807297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:58.808004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:58.808830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:58.809269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:58.839346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a7e53661-b242-4b03-8264-1107c89cf731 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 May 09 10:05:58.839904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 681/1338] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:59.791864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:59.792820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:59.799683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:59.800117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:59.800941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:59.801363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:59.831541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b5e9e31d-948f-4294-bcf8-4909041a4283 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043717 May 09 10:05:59.832140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 658/1339] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:05:59.850970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:05:59.852631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:05:59.859425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:59.859878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:59.860724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:05:59.861269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:05:59.892306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a19f0e61-4829-4eb2-baac-bfae6d6d8ccb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 May 09 10:05:59.896245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 682/1340] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:05:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:00.844702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:00.845661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:00.855186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:00.855937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:00.857224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:00.857956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:00.894611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a60e1442-b14a-43f0-8c4c-9aa863ff22cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054879 May 09 10:06:00.895139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 659/1341] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:00.903531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:00.904459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:00.911168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:00.911618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:00.912388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:00.912853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:00.944227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-263eba5b-15b8-4fe0-9790-3275547efc17 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 May 09 10:06:00.945017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 683/1342] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:01.908382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:01.909436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:01.916195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:01.916638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:01.917437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:01.917870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:01.951997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a69e4ef0-fa43-4bba-a37f-79923d1c8cb4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049368 May 09 10:06:01.952712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 660/1343] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:01.956595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:01.957719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:01.966392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:01.966985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:01.968292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:01.969101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:02.000890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42a55c2a-75ac-4fee-b088-9eb2548c331a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049308 May 09 10:06:02.002043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 684/1344] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:06:02.964008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:02.965038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:02.971865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:02.972311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:02.973163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:02.973603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:03.004677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d7c3cfc-dbaf-44d7-b21e-799815894828 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 May 09 10:06:03.005289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 661/1345] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:03.012555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:03.013509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:03.020697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:03.021135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:03.021919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:03.022352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:03.052781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ec187e3-8814-4eaa-804c-456e2c7aae4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 May 09 10:06:03.053533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 685/1346] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:04.016309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:04.017186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:04.024733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:04.024733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:04.025511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:04.025942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:04.056433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b3dc3860-3e8a-4799-b8f2-2809f9e9a975 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044181 May 09 10:06:04.057035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 662/1347] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:04.064099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:04.065129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:04.072020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:04.072470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:04.073481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:04.073906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:04.104918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf31ca08-92f6-49f1-bb70-1787e0148b22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 May 09 10:06:04.108753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 686/1348] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:05.068592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:05.069543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:05.075655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:05.076102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:05.076925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:05.077355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:05.107969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-734c1289-c18e-48a1-a9da-86a62d01dde6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 May 09 10:06:05.108531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 663/1349] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:05.116927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:05.117945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:05.125412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:05.125861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:05.126729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:05.127168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:05.164333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b352c74c-2140-4746-9444-f4252f1effe4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050627 May 09 10:06:05.168685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 687/1350] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:06.120265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:06.121222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:06.128132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:06.128574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:06.129364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:06.129796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:06.161933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07606971-20c0-4213-84c1-eb3ba8909c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045573 May 09 10:06:06.162976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 664/1351] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:06.176092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:06:06.177054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:06.185408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:06.186129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:06.187359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:06.188069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:06.292602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2be4fa37-150a-4f6a-9474-a0bff663d68c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/action" status: 200 len: 59707 microversion: 2.1 time: 0.119879 May 09 10:06:06.293312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 688/1352] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 10:06:06 2022] POST /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a/action => generated 59707 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:06:07.174798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:07.175750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:07.183186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:07.183654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:07.184454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:07.184934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:07.219209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-280b1b4a-5d41-40bf-9dcd-d28b28152432 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048729 May 09 10:06:07.219788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 665/1353] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:08.233070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:08.234277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:08.241960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:08.242414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:08.243205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:08.243641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:08.274648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78543fe4-c3f5-415d-9c90-2dc979fc6f70 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046833 May 09 10:06:08.275215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 689/1354] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:09.290988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:09.292373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:09.301744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:09.302227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:09.303034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:09.303500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:09.333149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-642b07c3-e6f7-40d5-aa7e-938d78304a31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049167 May 09 10:06:09.333713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 666/1355] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:10.345703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:10.346601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:10.353755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:10.354200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:10.354978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:10.355404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:10.390382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-706cae3f-ff73-480d-b74c-c20dc5336de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049126 May 09 10:06:10.390957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 690/1356] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:11.406049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:11.407543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:11.414537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:11.414992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:11.415783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:11.416221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:11.446323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9fe2c345-06d7-4391-8e8b-059431bd36f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046925 May 09 10:06:11.446883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 667/1357] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:12.458354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:12.459317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:12.466049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:12.466489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:12.467251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:12.467683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:12.501412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-693c1944-ca92-4c60-a78a-997a601f7c46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 May 09 10:06:12.501979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 691/1358] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:13.514414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:13.515233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:13.521959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:13.522411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:13.523230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:13.523725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:13.554828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-838162b1-45bb-4547-8c1c-6076b32136cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044196 May 09 10:06:13.555425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 668/1359] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:14.566271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:14.567184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:14.573945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:14.574417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:14.575167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:14.575593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:14.604867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4343bd3d-a8de-4ed9-a1a0-5d818bfd39f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 May 09 10:06:14.605408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 692/1360] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:15.616787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:15.617707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:15.624548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:15.625027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:15.625790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:15.626218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:15.656525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2df22602-bfaa-427c-9d57-21817bc99f12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 May 09 10:06:15.657131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 669/1361] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:16.668854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:16.669783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:16.679033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:16.679690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:16.680805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:16.681413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:16.716823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65f758eb-5a9b-402a-9612-1d26507c4ef4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051941 May 09 10:06:16.717417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 693/1362] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:17.729386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:17.730217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:17.737297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:17.737745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:17.738530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:17.738966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:17.768805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aa1efaf6-f7d0-4a5b-91bb-649ac22a2a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043798 May 09 10:06:17.769383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 670/1363] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:18.780321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:18.781273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:18.787863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:18.788307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:18.789100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:18.789533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:18.821447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0dd6bad6-d3b2-4a13-9c7c-a6c470c1d199 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045242 May 09 10:06:18.822037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 694/1364] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:19.835758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:19.836639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:19.843777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:19.844226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:19.845050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:19.845487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:19.878712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-00deec8e-9b1e-49e7-be87-8c194fb3009b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047056 May 09 10:06:19.879304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 671/1365] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:20.895965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:20.897572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:20.908352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:20.908836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:20.909625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:20.910074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:20.939251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ab7bd1fc-060d-4c14-b08d-f0768b164987 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050221 May 09 10:06:20.939808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 695/1366] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:21.952016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:21.952952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:21.960225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:21.960697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:21.961498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:21.961927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:21.991641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe69ab00-2190-43e6-949b-47214e2b14ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 May 09 10:06:21.992198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 672/1367] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:23.007187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:23.008513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:23.018756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:23.019202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:23.020014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:23.020449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:23.051065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad97c18a-e2c0-484d-acd6-3f55e9c7bfbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051203 May 09 10:06:23.051654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 696/1368] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:24.065085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:24.066014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:24.073047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:24.073491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:24.074256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:24.074684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:24.108096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4ab2e13-21a3-4b5d-ad3d-b8bfbd31906f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048714 May 09 10:06:24.108641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 673/1369] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:25.121584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:25.122536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:25.129526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:25.129978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:25.130750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:25.131192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:25.162039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2b4393a-9b01-4156-9a0d-879673c2e1fe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 May 09 10:06:25.162769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 697/1370] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:26.174880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:26.175812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:26.182887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:26.183342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:26.184148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:26.184557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:26.216059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e299c4e-c0c5-4e3a-bfcb-bc7422092e4a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 May 09 10:06:26.216654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 674/1371] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:27.229166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:27.229992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:27.236900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:27.237348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:27.238117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:27.238547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:27.268970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9a0af56d-82d7-44a1-a78a-3aab9ecb50ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 May 09 10:06:27.269596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 698/1372] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:28.281998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:28.282838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:28.289400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:28.289856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:28.290667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:28.291106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:28.321010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d9a23d2-4948-4547-9ebe-207566498d64 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043147 May 09 10:06:28.321580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 675/1373] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:29.333675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:29.334702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:29.341984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:29.342467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:29.343290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:29.343759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:29.374512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9bc4d72f-be95-41e5-ba3f-11d422d75623 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 May 09 10:06:29.375056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 699/1374] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:30.391832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:30.392810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:30.399625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:30.400080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:30.400891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:30.401336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:30.439168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd85f424-cabb-45f2-b38b-d737107d14be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054255 May 09 10:06:30.439748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 676/1375] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:31.451774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:31.452597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:31.459272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:31.459709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:31.460463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:31.460935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:31.490572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-05cb7f83-b2ee-44bd-bd50-1dc75b91488b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 May 09 10:06:31.491139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 700/1376] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:32.503442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:32.504297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:32.511372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:32.511829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:32.512614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:32.513086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:32.546237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4dc3f151-be8e-47de-8927-590e94864e37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047248 May 09 10:06:32.546808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 677/1377] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:33.558213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:33.559134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:33.566179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:33.566628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:33.567506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:33.567995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:33.598144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-71f3db44-2517-46b3-bfe7-802a288a4da5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 May 09 10:06:33.598700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 701/1378] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:34.612289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:34.613257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:34.620024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:34.620465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:34.621266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:34.621696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:34.653078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4b0cc06-c3cf-4b0f-a0fc-21671ddd13f8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044148 May 09 10:06:34.653078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 678/1379] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:35.667390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:35.668257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:35.676193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:35.676646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:35.677460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:35.678173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:35.709006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c11f0f0-3b87-46cd-83a9-73e4fe9a9a2a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 May 09 10:06:35.709568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 702/1380] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:36.721521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:36.722351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:36.729380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:36.729825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:36.730591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:36.731019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:36.760136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5818e90d-1734-4476-bf89-6a9ce4885be3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042778 May 09 10:06:36.760692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 679/1381] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:37.772385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:37.773596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:37.781489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:37.781937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:37.782704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:37.783133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:37.820762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb1f696a-9a01-435a-b34a-a1b41b3ddb2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052151 May 09 10:06:37.821246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 703/1382] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:38.832352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:38.833384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:38.841664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:38.842130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:38.842906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:38.843358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:38.883990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a62dcce-740f-4c6a-a121-6c594188c6f2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056052 May 09 10:06:38.884571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 680/1383] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:39.239473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:06:39.240083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:06:39.896213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:39.897159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:39.903906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:39.904347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:39.905144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:39.905602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:39.936597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-065e0ccc-d03b-483b-89f0-5cf8aa96e5a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044472 May 09 10:06:39.937179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 704/1384] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:40.951136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:40.952017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:40.959587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:40.960069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:40.960983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:40.961423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:40.993885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dabd0900-f499-4710-b6df-078a7377c854 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048331 May 09 10:06:40.994549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 681/1385] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:42.010811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:42.012454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:42.024596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:42.025673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:42.026920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:42.027616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:42.068310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1451d4f6-6803-4d43-9422-c5d0af12f0af tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064953 May 09 10:06:42.068963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 705/1386] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:43.083893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:43.085148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:43.093720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:43.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:43.095364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:43.096014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:43.129044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c713c1e8-e02c-449e-b1a4-063c3d58edb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050755 May 09 10:06:43.129596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 682/1387] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:44.144273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:44.145886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:44.156554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:44.157316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:44.158092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:44.158523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:44.190351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-828f24de-4059-49e8-963c-819f955a6613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052738 May 09 10:06:44.190891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 706/1388] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:45.202025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:45.202848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:45.209634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:45.210079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:45.210842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:45.211278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:45.240857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-657590bb-9350-4b28-ac26-140416407b5f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 May 09 10:06:45.241411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 683/1389] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:46.252623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:46.253613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:46.260708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:46.261206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:46.262001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:46.262461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:46.302592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-06dbbb4e-b18d-459b-ae2c-dbf20cff89c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054201 May 09 10:06:46.303172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 707/1390] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:47.314714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:47.315636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:47.322604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:47.323053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:47.323836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:47.324271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:47.354836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04f96377-06ae-4f18-ab88-36c9d42563e9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 May 09 10:06:47.355443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 684/1391] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:48.368931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:48.370003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:48.377372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:48.377828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:48.378596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:48.379034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:48.409243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a6552a7-45d0-49ce-b402-7257fe4a8e65 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 May 09 10:06:48.409792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 708/1392] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:49.427748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:49.429154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:49.439248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:49.439704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:49.440512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:49.440976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:49.470618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a6f056c-1a5e-44d4-9c8e-232a7c97e6a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049873 May 09 10:06:49.471199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 685/1393] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:50.483077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:50.483906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:50.490859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:50.491307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:50.492111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:50.492541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:50.522882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b2c8cf9-637a-42f9-ab94-5df7bfbfdfc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 May 09 10:06:50.523440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 709/1394] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:51.535898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:51.536868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:51.543626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:51.544077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:51.544896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:51.545330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:51.577560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-681505c3-7726-4531-ae71-9bd39a1f353f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 May 09 10:06:51.578162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 686/1395] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:52.590064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:52.590986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:52.598036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:52.598491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:52.599260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:52.599691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:52.629868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54e4c800-c60c-4c80-a2bd-a9cbb08b7750 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 May 09 10:06:52.630448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 710/1396] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:53.643656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:53.645028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:53.651819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:53.652274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:53.653144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:53.653634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:53.685096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f885279f-12e5-489a-8008-520993df9555 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 May 09 10:06:53.685671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 687/1397] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:54.697202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:54.698025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:54.704273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:54.704741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:54.705500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:54.705929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:54.737327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-73b87b66-a08d-494c-805b-a7da26d16d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 May 09 10:06:54.737870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 711/1398] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:55.749401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:55.750241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:55.757361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:55.757808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:55.758585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:55.759019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:55.789800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-617afc75-adfd-4734-b091-760d75972ff4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 May 09 10:06:55.790389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 688/1399] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:56.801956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:56.802884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:56.809769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:56.810226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:56.810985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:56.811455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:56.843934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42615278-4b50-4881-966d-cfa77922d72c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045986 May 09 10:06:56.844535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 712/1400] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:57.856390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:57.857238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:57.864098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:57.864548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:57.865359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:57.865790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:57.896290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b39e272-1e90-4b62-98c9-f56d497b32f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 May 09 10:06:57.896971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 689/1401] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:58.910143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:58.910982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:58.917906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:58.918343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:58.919510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:58.920230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:58.953273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a389b0d0-8efd-4d24-ae65-288a4fd7e89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047190 May 09 10:06:58.953830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 713/1402] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:06:59.965384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:06:59.966206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:06:59.973152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:59.973624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:06:59.974396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:06:59.974848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:00.006068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e015ecc-acd6-4832-9f17-b9eb912b90e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 May 09 10:07:00.006627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 690/1403] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:06:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:01.019215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:01.020078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:01.026607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:01.027077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:01.027834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:01.028261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:01.056652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6486fc29-4d71-486c-9f7f-a88160c20594 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042380 May 09 10:07:01.057233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 714/1404] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:02.068655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:02.069628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:02.076469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:02.076952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:02.077738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:02.078177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:02.109402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-182bf9a0-cdb8-4ac1-a2f1-8699b9418f72 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 May 09 10:07:02.109988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 691/1405] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:03.121670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:03.122540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:03.129445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:03.129902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:03.130671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:03.131109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:03.161592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3e3e3be2-c385-4064-8b59-33ad1e2e994e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 May 09 10:07:03.162186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 715/1406] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:04.174143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:04.175010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:04.181901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:04.182354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:04.183124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:04.183560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:04.212936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25697a0a-c9f2-4d14-aaff-6326bc63fcaa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 May 09 10:07:04.213500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 692/1407] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:05.224047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:05.224875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:05.231765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:05.232238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:05.233015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:05.233449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:05.263166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2ce05f8-11d0-4c94-9831-7b0243384374 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 May 09 10:07:05.263738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 716/1408] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:06.275073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:06.276022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:06.282890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:06.283334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:06.284110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:06.284547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:06.314048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5560174-dc1a-4eea-81ee-ebb0cb9a245c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042914 May 09 10:07:06.314520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 693/1409] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:07.326110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:07.327043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:07.334347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:07.334828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:07.335595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:07.336034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:07.367876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1e2b21d-2922-4175-ba10-bb3ca46cbd2f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 May 09 10:07:07.368460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 717/1410] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:08.380071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:08.381024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:08.388307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:08.388782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:08.389679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:08.390304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:08.425738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-153e860a-c7d1-4ff2-a3dd-6da839b30c76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049664 May 09 10:07:08.426304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 694/1411] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:09.437871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:09.439817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:09.447076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:09.448032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:09.449606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:09.450137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:09.482511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-abcdc2b0-3b63-4ee3-a8f7-49118c5b750f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048678 May 09 10:07:09.483100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 718/1412] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:10.497503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:10.498516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:10.505948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:10.506397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:10.507209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:10.507647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:10.537541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc0b82ad-f6fc-480e-9145-2d63370ad582 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 May 09 10:07:10.538110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 695/1413] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:11.549575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:11.550534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:11.557641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:11.558225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:11.559009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:11.559446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:11.591247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f3e7390e-d6c6-4877-87a9-5b450c1b2f02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 May 09 10:07:11.591807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 719/1414] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:12.603637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:12.604485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:12.611046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:12.611505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:12.612294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:12.612772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:12.642939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-802317d8-1462-4363-86d8-ab15b7c3894e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 May 09 10:07:12.643525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 696/1415] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:13.655864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:13.656812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:13.663704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:13.664143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:13.664953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:13.665383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:13.695731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5004b921-699a-4c92-9332-518d10eb3f1b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 May 09 10:07:13.696312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 720/1416] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:14.711410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:14.712489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:14.722899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:14.723423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:14.724607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:14.725215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:14.757650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1b49a2c-4f3e-472a-9f4c-fe14e3db3872 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052470 May 09 10:07:14.758214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 697/1417] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:15.769841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:15.770702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:15.777503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:15.777933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:15.778698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:15.779132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:15.809011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de077533-07bf-4317-aaa8-0701e4006016 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 May 09 10:07:15.809585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 721/1418] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:16.821100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:16.822020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:16.829017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:16.829469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:16.830249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:16.830685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:16.860917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-806dd9b8-bb8c-449a-8fd3-ee5f5ef3f0be tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 May 09 10:07:16.861529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 698/1419] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:17.873003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:17.873944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:17.880929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:17.881370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:17.882132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:17.882562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:17.918049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3213716c-0a27-43c2-9bd2-08082de6fd6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049123 May 09 10:07:17.918649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 722/1420] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:18.930165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:18.931136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:18.937881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:18.938322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:18.939097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:18.939530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:18.971341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b826bb95-d948-4c05-84c5-f91a77f90f01 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 May 09 10:07:18.971911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 699/1421] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:19.986761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:19.987630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:19.994397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:19.994844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:19.995612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:19.996042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:20.027591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-507859f2-3606-4b97-a35c-d394f82fd386 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046670 May 09 10:07:20.028128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 723/1422] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:21.039672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:21.040628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:21.047502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:21.047944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:21.048750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:21.049184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:21.079287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e7361de-2777-4680-a380-dfd392de0efb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 May 09 10:07:21.079782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 700/1423] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:22.091295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:22.092229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:22.099327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:22.099808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:22.100574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:22.101032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:22.131207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-710f8f66-ab6e-4186-b41a-5af19066e7c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 May 09 10:07:22.131774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 724/1424] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:23.143221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:23.144171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:23.151534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:23.151978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:23.152810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:23.153244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:23.183055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1aa074de-1ac2-4937-9f67-6bc5461e809d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 May 09 10:07:23.183612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 701/1425] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:24.195123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:24.196152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:24.202809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:24.203252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:24.204023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:24.204485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:24.234634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42b974a5-a244-4d85-b6b4-c8c748b7833b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 May 09 10:07:24.235185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 725/1426] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:25.247157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:25.247996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:25.254557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:25.255001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:25.255769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:25.256195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:25.285324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a340b68d-012b-4556-8030-d2c043b4faf5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042276 May 09 10:07:25.285894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 702/1427] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:26.297276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:26.298197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:26.304968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:26.305415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:26.306196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:26.306619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:26.336832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a3bcbd1-d587-4a88-8712-279a2f9201f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 May 09 10:07:26.337408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 726/1428] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:27.349160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:27.350133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:27.357983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:27.358436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:27.359263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:27.359741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:27.389333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6620b4af-dcf4-4062-ae20-d2ea4457a326 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 May 09 10:07:27.389900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 703/1429] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:28.403077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:28.404015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:28.410974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:28.411426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:28.412476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:28.412952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:28.443765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77d5b6ef-dd8a-4adc-a49d-84cc4127c056 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 May 09 10:07:28.444325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 727/1430] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:29.456972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:29.457789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:29.463895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:29.464350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:29.465183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:29.465601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:29.494844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-64e051f5-a36b-4ece-92b0-ecddc57d038e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 May 09 10:07:29.495401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 704/1431] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:30.506125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:30.507044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:30.513782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:30.514219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:30.515072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:30.515497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:30.545001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ed56b0d-4a17-41ea-b66c-799ad0f42a12 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 May 09 10:07:30.545566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 728/1432] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:31.557315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:31.558340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:31.565564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:31.566013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:31.566779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:31.567213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:31.596050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f24283eb-92d2-4993-8975-4100a1a7517c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042931 May 09 10:07:31.596633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 705/1433] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:32.608197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:32.609299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:32.616124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:32.616581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:32.617385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:32.617825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:32.648182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dce2bef2-bd13-450f-bb86-5a0b0ffc1614 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 May 09 10:07:32.648798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 729/1434] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:33.661077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:33.662691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:33.669738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:33.670188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:33.670959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:33.671396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:33.700781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d98cc488-8f3a-48b0-b56f-8210cef3c932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 May 09 10:07:33.701340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 706/1435] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:34.712814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:34.713652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:34.720458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:34.720928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:34.721689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:34.722111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:34.751778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-998972f0-6f33-4020-86ad-fa15c4f1b4de tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 May 09 10:07:34.752300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 730/1436] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:35.763826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:35.764849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:35.771612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:35.772062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:35.772902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:35.773333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:35.802546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f0babf6f-0bd3-471a-8663-6ebd6e027086 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 May 09 10:07:35.803105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 707/1437] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:36.814943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:36.815864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:36.822587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:36.823035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:36.823796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:36.824221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:36.853977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f5cf69e-8090-4149-9427-2352b0d2cbab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 May 09 10:07:36.854534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 731/1438] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:37.867188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:37.868118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:37.875967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:37.876412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:37.877228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:37.877655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:37.909842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-707383d5-d1f7-4150-9efa-b5c0f693c618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047856 May 09 10:07:37.910486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 708/1439] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:38.922006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:38.922965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:38.929847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:38.930298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:38.931068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:38.931503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:38.961272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4874904-a7fd-403c-b9db-690baffb0683 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 May 09 10:07:38.961826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 732/1440] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:39.973315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:39.974245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:39.981270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:39.981725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:39.982499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:39.982939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:40.012401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e8ee2756-ecb1-48d3-9571-2cd3fddb0709 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 May 09 10:07:40.013023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 709/1441] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:41.024423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:41.025319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:41.032024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:41.032466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:41.033258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:41.033683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:41.063890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a40e094-6313-4445-9382-edd852c6b980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043504 May 09 10:07:41.064447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 733/1442] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:42.076095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:42.077067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:42.084804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:42.085275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:42.086528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:42.087248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:42.125058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7cf3681-57d0-431d-b998-4fd779c342c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053019 May 09 10:07:42.125648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 710/1443] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:43.137242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:43.138162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:43.145077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:43.145525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:43.146311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:43.146731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:43.176571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53ea9e33-23fb-4859-be6e-c01172e649e7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 May 09 10:07:43.177212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 734/1444] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:44.187817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:44.188756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:44.195055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:44.195502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:44.196260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:44.196696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:44.226475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d574bf7a-5e7a-4998-954f-56eff6c02b76 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042718 May 09 10:07:44.227006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 711/1445] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:45.239775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:45.240688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:45.247418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:45.247860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:45.248696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:45.249106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:45.278404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f58eb003-75ca-4bf4-b1b5-c38b58804818 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 May 09 10:07:45.278960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 735/1446] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:46.290124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:46.291053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:46.298154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:46.298612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:46.299393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:46.299831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:46.330070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e757fabd-5324-46f4-9b25-47d4c01c4a1a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 May 09 10:07:46.330643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 712/1447] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:47.343923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:47.344864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:47.351704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:47.352149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:47.353235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:47.353684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:47.384004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d221e521-702c-4445-ac59-0e1d9a5ffad1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 May 09 10:07:47.384570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 736/1448] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:48.396383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:48.397339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:48.404198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:48.404649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:48.405456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:48.405889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:48.439076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b34f5e28-4704-41b9-9d8b-db161bea3513 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046675 May 09 10:07:48.439655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 713/1449] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:49.451833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:49.453050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:49.460821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:49.461264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:49.462036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:49.462733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:49.494020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-860b5511-53ba-4303-ab0f-6156107b2de3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046754 May 09 10:07:49.494591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 737/1450] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:50.508867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:50.510189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:50.518693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:50.519135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:50.519917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:50.520342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:50.551326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-250c371b-2d3d-443b-ba64-08b5bde858db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049064 May 09 10:07:50.551906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 714/1451] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:51.563615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:51.564535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:51.571406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:51.571853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:51.572621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:51.573178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:51.603935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c29392e-fd9e-4fca-a1d0-c75fb1a90b15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 May 09 10:07:51.604494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 738/1452] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:52.616074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:52.617015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:52.624267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:52.624718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:52.625858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:52.627333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:52.662469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b23501cc-caea-4521-9848-2dea1e6c1443 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050444 May 09 10:07:52.663036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 715/1453] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:53.674736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:53.675659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:53.682686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:53.683138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:53.683910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:53.684342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:53.717850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f6608b1-4f3a-40af-9c05-6d6ac5a6f986 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047368 May 09 10:07:53.718660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 739/1454] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:54.730170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:54.731096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:54.737980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:54.738434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:54.739207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:54.739642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:54.771843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b16709c1-48d2-462b-8d6a-6bf203bf6c71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045943 May 09 10:07:54.772415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 716/1455] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:55.784113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:55.785070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:55.791807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:55.792245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:55.793052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:55.793481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:55.823070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea9808af-9d80-425d-842e-b803ca4069bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 May 09 10:07:55.823623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 740/1456] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:56.835290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:56.836325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:56.843178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:56.843631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:56.844413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:56.844914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:56.875309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ffa29d2-821d-4014-b66d-c35a31740ae0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 May 09 10:07:56.875871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 717/1457] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:57.887322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:57.888145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:57.894924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:57.895409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:57.896184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:57.896621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:57.926911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d2f2cda-7fae-4c7d-8f49-5dc64b4b144a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 May 09 10:07:57.927481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 741/1458] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:58.939460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:58.940393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:58.947279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:58.947735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:58.948510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:58.948978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:07:58.979292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-89bd12cd-84c3-43a2-b451-de08c24162d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 May 09 10:07:58.979854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 718/1459] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:07:59.991374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:07:59.992247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:07:59.999226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:07:59.999677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:00.000439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:00.000914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:00.030220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d5065cfe-8834-4968-be41-41859f4a9e44 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042882 May 09 10:08:00.030769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 742/1460] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:07:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:01.042178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:01.043120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:01.049996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:01.050451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:01.051230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:01.051671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:01.081423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-be295c4c-28c4-42e8-95db-4afbc88cc863 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 May 09 10:08:01.081976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 719/1461] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:02.093405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:02.094335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:02.101203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:02.101650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:02.102751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:02.103189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:02.133363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2fa4bbd0-dd5e-4ca6-9301-9a698c6ebe0c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 May 09 10:08:02.133918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 743/1462] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:03.145866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:03.146709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:03.153467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:03.153925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:03.154793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:03.155232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:03.185003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ae4ab2ad-b05d-45e8-bb04-91a136805a3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043208 May 09 10:08:03.185561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 720/1463] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:04.197193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:04.198030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:04.204996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:04.205448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:04.206227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:04.206661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:04.237385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f2656932-49ef-4bd9-97da-d9b3cc9a7932 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 May 09 10:08:04.237936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 744/1464] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:05.248909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:05.249749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:05.256526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:05.257008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:05.257780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:05.258207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:05.287914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-181a3b9a-a16d-496b-a102-7cf27e1cb613 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 May 09 10:08:05.288473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 721/1465] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:06.300025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:06.300986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:06.307750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:06.308194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:06.308988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:06.309418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:06.339153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db27c7bb-4a1d-4729-8b2c-a312f568975d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 May 09 10:08:06.339714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 745/1466] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:07.351584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:07.352751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:07.359585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:07.360034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:07.360854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:07.361293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:07.391190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d011a0d3-b256-49d4-8658-277b86c25c48 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 May 09 10:08:07.391755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 722/1467] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:08.402849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:08.403690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:08.410660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:08.411110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:08.411866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:08.412297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:08.441865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0b8889a-e683-4209-adf7-9777443f7871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 May 09 10:08:08.442399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 746/1468] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:09.453724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:09.455737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:09.462661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:09.463144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:09.463962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:09.464394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:09.494255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd6f88a1-1fd3-4aeb-a584-3e943b8be7b9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 May 09 10:08:09.494819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 723/1469] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:10.506254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:10.507095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:10.514060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:10.514509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:10.515278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:10.515706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:10.546141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b664a2c-a1f8-4c5f-aa5a-7fe11563ce8d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 May 09 10:08:10.546707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 747/1470] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:11.558171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:11.559101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:11.566026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:11.566475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:11.567256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:11.567700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:11.597786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9af9ebbb-5c8d-47ae-b957-f2accb821858 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 May 09 10:08:11.598350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 724/1471] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:12.609955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:12.610915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:12.617811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:12.618263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:12.619021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:12.619459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:12.648571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d627d49-2752-4e55-a79a-41dbdbe63073 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 May 09 10:08:12.649149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 748/1472] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:13.660616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:13.661485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:13.667891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:13.668339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:13.669158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:13.669591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:13.699692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97dd902b-22a5-4dcf-8078-87bd83f5f0f3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 May 09 10:08:13.700247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 725/1473] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:14.711626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:14.712557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:14.719321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:14.719774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:14.720539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:14.721018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:14.751276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f196b64-2462-4a55-9302-b1ccaf12e5c4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 May 09 10:08:14.751832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 749/1474] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:15.763329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:15.764252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:15.771117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:15.771571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:15.772349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:15.772819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:15.802635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ceecf78-eeac-45ec-8a36-3f0153d61275 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043269 May 09 10:08:15.803209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 726/1475] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:16.814570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:16.815496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:16.822100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:16.822547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:16.823317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:16.823747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:16.854033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0c062c88-83b7-4160-a694-cd33efd58d16 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043484 May 09 10:08:16.854612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 750/1476] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:17.866169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:17.867105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:17.874195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:17.874647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:17.875472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:17.875905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:17.906041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4d41362-9649-4e70-ab14-85b20dcaad37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 May 09 10:08:17.906624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 727/1477] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:18.917814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:18.918743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:18.925738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:18.926182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:18.926963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:18.927391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:18.957041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-05d62544-b75f-4d0b-9954-7934b1c03a62 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043216 May 09 10:08:18.957595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 751/1478] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:19.968877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:19.969876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:19.976394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:19.976908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:19.978003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:19.978444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:20.008127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-790594bd-3ce4-4121-a29b-96f3c4e1cfe2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043301 May 09 10:08:20.008693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 728/1479] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:21.019904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:21.020877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:21.027679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:21.028127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:21.029006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:21.029453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:21.058198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0576b757-c607-4e5f-8cd9-8cc5ec188bd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 May 09 10:08:21.058743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 752/1480] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:22.070448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:22.071380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:22.078714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:22.079505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:22.080293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:22.080760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:22.113300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0db294ce-e67e-482f-ba10-3b172b4a75cb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 May 09 10:08:22.113852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 729/1481] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:23.126372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:23.127301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:23.133718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:23.134171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:23.134977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:23.135410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:23.166648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-07674ae1-5f63-494a-aa81-e9c963314d24 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 May 09 10:08:23.167254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 753/1482] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:24.178547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:24.179510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:24.186243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:24.186693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:24.187459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:24.187885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:24.218097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-82ee6400-d9e8-401f-ba47-f29b1508a53d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 May 09 10:08:24.218663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 730/1483] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:25.230046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:25.230991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:25.237566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:25.238006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:25.238803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:25.239226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:25.270533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d6a854f-2638-4b73-a19a-bc2bfef316cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 May 09 10:08:25.271101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 754/1484] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:26.282759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:26.284274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:26.291287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:26.291735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:26.292501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:26.292970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:26.322680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fff62226-b3fa-4301-b065-1d26995e1054 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043965 May 09 10:08:26.323258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 731/1485] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:27.337672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:27.338604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:27.345495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:27.345946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:27.346702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:27.347166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:27.378013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-acca7d18-73ae-4722-9a00-d416c3aa5518 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 May 09 10:08:27.378564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 755/1486] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:28.389323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:28.390273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:28.397061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:28.397520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:28.398333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:28.398769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:28.428588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90c02493-d61b-429e-b81f-18825f83201b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043454 May 09 10:08:28.429188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 732/1487] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:29.440863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:29.441794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:29.448237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:29.448692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:29.449541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:29.449957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:29.483167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec4b550e-c86e-49c5-9eab-36c8f73f44b2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046224 May 09 10:08:29.483718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 756/1488] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:30.494553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:30.495460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:30.502091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:30.502534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:30.503300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:30.503732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:30.533639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a81ef082-14ee-4da4-bf56-c03485e7fc31 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 May 09 10:08:30.534196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 733/1489] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:31.545384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:31.546315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:31.552554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:31.553043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:31.553858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:31.554305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:31.584051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5d5ac83-ba00-4263-b7b5-558c483130d5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042591 May 09 10:08:31.584635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 757/1490] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:32.596070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:32.597114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:32.605269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:32.605455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:32.606342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:32.606977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:32.637145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-94cb5cb4-78af-48e5-8499-fb4ba157107f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 May 09 10:08:32.637707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 734/1491] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:33.648827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:33.649788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:33.656436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:33.656931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:33.657707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:33.658134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:33.687864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4e3f3664-d44d-4283-8581-29e275527d80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042960 May 09 10:08:33.688426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 758/1492] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:34.698931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:34.699886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:34.706468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:34.706917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:34.707804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:34.708115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:34.737771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a5402bf-7e3b-4318-ae7c-efe74dba528e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 May 09 10:08:34.738324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 735/1493] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:35.749430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:35.750350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:35.757040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:35.757481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:35.758250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:35.758679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:35.789478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c466cec-6699-4047-9eab-421fbf6d0ff7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 May 09 10:08:35.790035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 759/1494] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:36.801028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:36.801966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:36.808695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:36.809150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:36.810047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:36.810488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:36.841458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-30fe9966-9037-42c8-8e07-9db74bab4638 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044336 May 09 10:08:36.842026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 736/1495] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:37.853446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:37.854490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:37.861270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:37.861714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:37.862479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:37.862903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:37.910540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ae575da-c66a-4f95-a1c3-c973d927a523 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061354 May 09 10:08:37.911109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 760/1496] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:38.921948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:38.922886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:38.929670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:38.930131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:38.930920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:38.931327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:38.962128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e620d01-085c-48ea-81ee-8a5f97a05765 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 May 09 10:08:38.962720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 737/1497] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:39.973969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:39.975026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:39.982238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:39.982883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:39.983654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:39.984080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:40.013989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb1d6ead-9561-404a-8a82-7ed5e1377048 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 May 09 10:08:40.014540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 761/1498] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:41.028624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:41.029193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:41.036464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:41.036967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:41.037769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:41.038203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:41.069458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f34a73d1-a739-443d-97a5-87df9c38f84a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046889 May 09 10:08:41.070017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 738/1499] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:42.082497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:42.084162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:42.091322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:42.092588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:42.093427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:42.093858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:42.124475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b50b2047-0091-4998-bbce-66a9e35d99f7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 May 09 10:08:42.125064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 762/1500] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:43.136438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:43.137518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:43.144240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:43.144695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:43.145496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:43.145931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:43.175559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac3d9e87-a09f-4b8e-b3d9-71da1986ea19 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 May 09 10:08:43.176124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 739/1501] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:44.187838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:44.188690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:44.195620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:44.196067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:44.196873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:44.197309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:44.227489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ba8b6ea-fffd-4ef4-848c-86e1a7622478 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 May 09 10:08:44.228053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 763/1502] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:45.239563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:45.240374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:45.246953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:45.247404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:45.248169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:45.248598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:45.277494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b2fb26f-8a75-41bc-bfcb-6334747fd059 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042016 May 09 10:08:45.278040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 740/1503] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:46.291762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:46.292842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:46.299875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:46.300331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:46.301139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:46.301575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:46.331665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0760d275-32a8-407a-86cc-ab3c75599c99 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043915 May 09 10:08:46.332220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 764/1504] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:47.343254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:47.344116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:47.350964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:47.351416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:47.352589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:47.352965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:47.383418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9ca95e4-5fb7-445a-8dc8-48a81df2a394 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 May 09 10:08:47.383997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 741/1505] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:48.395487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:48.396376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:48.403313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:48.403765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:48.404508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:48.405013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:48.439482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1ef2978-9c6e-4deb-b992-ac414dcb6aa3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047970 May 09 10:08:48.440044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 765/1506] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:49.452237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:49.453092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:49.459808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:49.460258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:49.461034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:49.461881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:49.493128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8917041e-198c-474d-9702-8abcd5f31353 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 May 09 10:08:49.493944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 742/1507] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:50.504949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:50.505777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:50.512687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:50.513164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:50.513933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:50.514365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:50.548000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6f51cf23-66f5-4e12-b2a8-382efc9b0c7e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047078 May 09 10:08:50.548584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 766/1508] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:51.560074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:51.560931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:51.567889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:51.568345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:51.569181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:51.569618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:51.603404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0257b226-3a25-4447-97a8-e81cf02e37d8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 May 09 10:08:51.604010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 743/1509] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:52.615736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:52.616580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:52.623645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:52.624098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:52.624915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:52.625353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:52.658066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd5ddc2e-77df-42a5-ad8e-c38521c48069 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046484 May 09 10:08:52.658619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 767/1510] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:53.670192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:53.671022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:53.677884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:53.678342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:53.679119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:53.679555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:53.710912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f484530b-5262-49cf-a64a-f55a0f1b2358 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 May 09 10:08:53.711575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 744/1511] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:54.724003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:54.725003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:54.733348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:54.733858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:54.735008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:54.735450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:54.768737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4093a0b-8b04-480e-ac0c-f8abcc22f620 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048854 May 09 10:08:54.769340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 768/1512] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:55.780761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:55.781621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:55.788363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:55.788844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:55.789625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:55.790059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:55.821090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-752a9d06-fd12-432f-a663-ea78b538470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044290 May 09 10:08:55.821671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 745/1513] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:56.833224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:56.834142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:56.841576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:56.841961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:56.842844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:56.843300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:56.873466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-553fada0-f95f-436a-8d04-b30f2dbf9acc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 May 09 10:08:56.874048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 769/1514] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:57.887269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:57.888758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:57.895953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:57.896336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:57.897150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:57.897576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:57.927659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f51ffa1d-09b2-4d6d-a9d9-3cae151e6e5c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046242 May 09 10:08:57.931462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 746/1515] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:58.939551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:58.940523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:58.947325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:58.947842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:58.948543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:58.949013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:58.978844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b95d1c43-3b13-4655-971d-29ba88cdddc6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 May 09 10:08:58.979383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 770/1516] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:08:59.990994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:08:59.991914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:08:59.998522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:08:59.998973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:08:59.999739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:00.000172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:00.029739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e71438e-b881-463f-a1c9-4cdef4528dec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042726 May 09 10:09:00.030204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 747/1517] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:08:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:00.415763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:09:00.415987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:09:01.041271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:01.042198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:01.049196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:01.049663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:01.050430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:01.050859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:01.081804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d818114-7813-4fb8-b0ba-d8142bb40344 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 May 09 10:09:01.082283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 771/1518] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:02.094512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:02.095541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:02.102755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:02.103202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:02.103988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:02.104415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:02.137349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ce59a7a-62c8-4a3a-93bd-d4f195ac391e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047463 May 09 10:09:02.137936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 748/1519] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:03.149494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:03.150413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:03.157734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:03.158178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:03.158947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:03.159380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:03.189621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39ee7094-46f4-4bb3-8669-157fa1c69641 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 May 09 10:09:03.190083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 772/1520] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:04.202430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:04.203393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:04.210351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:04.210805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:04.211590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:04.212036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:04.242230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca801ea8-f2bc-4f50-b5af-5df9013e2170 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 May 09 10:09:04.242708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 749/1521] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:05.040193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:09:05.040402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:09:05.323806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:05.324811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:05.330996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:05.331334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:05.332105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:05.332535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:05.362495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-976f87c9-9032-4c17-bb52-63276d71a6e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111859 May 09 10:09:05.363085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 773/1522] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:06.377119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:06.378503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:06.385124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:06.385580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:06.386365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:06.386977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:06.421460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f7aab1f-3da2-43a0-b0a0-6728eb659c14 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050231 May 09 10:09:06.422371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 750/1523] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:07.433168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:07.434252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:07.440719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:07.441189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:07.441994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:07.442430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:07.472170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64f271e1-99f3-4b45-b862-fef2cfa1bdf0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043456 May 09 10:09:07.472940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 774/1524] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:08.483759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:08.484709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:08.491014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:08.491458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:08.492237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:08.492688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:08.522941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8450993e-fae8-4c1f-85ba-35c2f25e9de2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 May 09 10:09:08.523525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 751/1525] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:09.534179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:09.535100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:09.542354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:09.542801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:09.543673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:09.544101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:09.574592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-73a0880d-d8a1-45db-9d05-0d7980801fbc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 May 09 10:09:09.575493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 775/1526] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:10.587556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:10.588516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:10.595507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:10.595992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:10.596802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:10.597234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:10.627903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-14eb713c-8147-4b11-9205-87681fb7ec7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 May 09 10:09:10.628459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 752/1527] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:11.640062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:11.640931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:11.647684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:11.648144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:11.648923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:11.649378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:11.679717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8821d89e-f05d-4559-8198-017473faf32a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 May 09 10:09:11.680306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 776/1528] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:11.916269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:09:11.916525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:09:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:09:12.691997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:12.692861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:12.699514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:12.699969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:12.700767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:12.701199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:12.730842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1eb7c277-9696-4579-b870-e3c544e2d3ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 May 09 10:09:12.731440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 753/1529] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:13.742965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:13.743797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:13.750835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:13.751317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:13.752178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:13.752518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:13.786022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dd9663b5-0b62-4e8e-b6c8-e65e92fe1f68 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047132 May 09 10:09:13.786600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 777/1530] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:14.798238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:14.799189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:14.806288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:14.806736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:14.807501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:14.808012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:14.839430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f87edc48-277f-45a4-92ac-818bedfa2e93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 May 09 10:09:14.840453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 754/1531] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:15.852130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:15.852984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:15.859919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:15.860369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:15.861259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:15.861690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:15.891370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d71ec740-d6d4-4d93-afad-98891c609aea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 May 09 10:09:15.891938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 778/1532] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:16.903018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:16.903858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:16.910575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:16.911047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:16.911841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:16.912273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:16.941854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97fdff84-afb0-4620-9d3b-b25b3136bdfb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 May 09 10:09:16.942433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 755/1533] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:17.953979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:17.954831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:17.961541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:17.961985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:17.962752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:17.963178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:17.994613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7a261c1-5cca-4ba5-adae-af0d2de16cd5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 May 09 10:09:17.995179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 779/1534] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:19.006588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:19.007430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:19.014265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:19.014717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:19.015493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:19.015930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:19.046855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a5210b7-c88c-42f9-bab8-cd9a50933715 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 May 09 10:09:19.047437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 756/1535] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:20.059029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:20.059967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:20.066848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:20.067337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:20.068174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:20.068541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:20.098441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dbacf9e2-4cf0-42cb-9638-79618dc4c186 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043521 May 09 10:09:20.099052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 780/1536] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:20.165156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:09:20.165353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:09:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:09:21.110991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:21.111834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:21.118686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:21.119136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:21.119908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:21.120314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:21.149688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb855ab1-aa63-4436-aa4c-d4ca93306bc7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 May 09 10:09:21.150262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 757/1537] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:22.161780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:22.162639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:22.169468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:22.169910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:22.170667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:22.171094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:22.201091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51f99144-5f5e-411d-abe6-da8264cb9125 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043359 May 09 10:09:22.201654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 781/1538] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:23.213071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:23.213897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:23.220693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:23.221160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:23.221931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:23.222361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:23.254598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ad8a286b-3bb6-4a12-a3dd-bbb2d88c98e0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 May 09 10:09:23.255210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 758/1539] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:24.267122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:24.267961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:24.274218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:24.274692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:24.275461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:24.275924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:24.305661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0586afc9-a851-421f-b1f6-3df59872837e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 May 09 10:09:24.306233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 782/1540] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:25.319377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:25.320245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:25.329715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:25.330174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:25.330950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:25.331384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:25.362500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dfc52ddd-a3bf-41ec-a863-e155d43d48d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048594 May 09 10:09:25.363077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 759/1541] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:26.374937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:26.375771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:26.382643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:26.383089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:26.383855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:26.384288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:26.413687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3887c4cb-ef9c-4084-a2db-4d0d0d11b8ae tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 May 09 10:09:26.414463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 783/1542] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:27.426103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:27.426921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:27.433810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:27.434285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:27.435034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:27.435470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:27.464859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-55def6cb-c64a-4c6f-a3d3-469e4664fa56 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 May 09 10:09:27.465421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 760/1543] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:28.477793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:28.478625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:28.485652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:28.486135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:28.486897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:28.487336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:28.516380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4b25a87-7a61-4ecd-bb28-c95cfeff4980 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 May 09 10:09:28.516979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 784/1544] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:29.528076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:29.528966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:29.535578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:29.536031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:29.536875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:29.537318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:29.568827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0b126d0-6a90-4230-a3ff-1e59d2401c09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 May 09 10:09:29.569414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 761/1545] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:30.581013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:30.581945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:30.588758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:30.589251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:30.590051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:30.590490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:30.620846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e3636d5d-efb4-4592-a3ed-7e03d730a521 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043741 May 09 10:09:30.621387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 785/1546] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:31.633020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:31.633853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:31.640773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:31.641219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:31.641988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:31.642418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:31.673831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c40dbba9-0b4e-45b0-8eec-0b2976de3983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 May 09 10:09:31.674412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 762/1547] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:32.686056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:32.686886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:32.693594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:32.694039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:32.694812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:32.695422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:32.733126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bcb78335-3027-4099-ad7a-5f33173cb36a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050797 May 09 10:09:32.733707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 786/1548] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:33.745256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:33.746102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:33.753060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:33.753513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:33.754304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:33.754740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:33.786101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e071c95-3fa9-43e3-a3f8-db8ca6e6e421 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 May 09 10:09:33.786694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 763/1549] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:34.798936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:34.800063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:34.807656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:34.808145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:34.808981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:34.809415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:34.841718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b15d54d1-a1e0-4ad5-a204-c49497edcdb7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047345 May 09 10:09:34.842296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 787/1550] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:35.855405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:35.856283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:35.864175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:35.864630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:35.865435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:35.865872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:35.895569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2eadb7ed-e499-4f19-9376-e5156a82c12d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 May 09 10:09:35.896129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 764/1551] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:36.908004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:36.908982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:36.915997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:36.916440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:36.917368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:36.917807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:36.947688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56f88f0e-9fe4-46f5-923f-d624e19c04c5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044102 May 09 10:09:36.948404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 788/1552] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:37.959791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:37.960636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:37.968811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:37.969254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:37.971261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:37.971758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:38.003076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25f412d6-0a21-4fb2-81a9-0559613f89dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047330 May 09 10:09:38.003646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 765/1553] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:38.810442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:09:38.810608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:09:39.015792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:39.016782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:39.023400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:39.023848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:39.024626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:39.025086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:39.055682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4d0ac35-424a-4581-9cd0-2e53efe5d86d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 May 09 10:09:39.056253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 789/1554] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:40.067749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:40.068583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:40.075453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:40.075907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:40.076692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:40.077158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:40.107205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4fc2b96f-0b0c-4fc4-9444-a3b070830cee tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 May 09 10:09:40.107757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 766/1555] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:41.119025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:41.119873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:41.127277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:41.127722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:41.128491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:41.128963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:41.158499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-070de96b-f587-4535-94ee-d122b1236f6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 May 09 10:09:41.159043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 790/1556] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:42.170073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:42.170934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:42.177806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:42.178264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:42.179030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:42.179467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:42.209495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a49b4db-c918-445a-bdec-c42fd7731cfe tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 May 09 10:09:42.210073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 767/1557] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:43.221598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:43.222590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:43.229654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:43.230105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:43.230872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:43.231312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:43.260079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e21f164b-adb6-4d39-99b4-855386e533f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042571 May 09 10:09:43.260656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 791/1558] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:44.273805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:44.274760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:44.281504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:44.281907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:44.282752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:44.283187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:44.312793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-12436e40-efde-460c-bc60-277f1918c2eb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 May 09 10:09:44.313362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 768/1559] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:45.325014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:45.325926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:45.333629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:45.334423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:45.335745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:45.336182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:45.365716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d2a3587-6334-426e-8864-5b7f1691ab15 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 May 09 10:09:45.366162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 792/1560] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:46.377626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:46.378556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:46.385273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:46.385762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:46.386532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:46.386966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:46.416192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-49948ec0-563c-4462-a2ce-2eda8062111c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042602 May 09 10:09:46.416853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 769/1561] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:47.428407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:47.429357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:47.436146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:47.436596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:47.437381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:47.437809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:47.468410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96472536-a4f1-4bb0-8e1e-de863713c23a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 May 09 10:09:47.468922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 793/1562] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:48.480310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:48.481179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:48.488118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:48.488576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:48.489650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:48.490377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:48.522766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34afd03f-4ffc-4f0e-93b2-2d603ec7c8dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 May 09 10:09:48.523328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 770/1563] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:49.535245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:49.536148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:49.543159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:49.543603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:49.544394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:49.544862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:49.575439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41e9ed45-c45b-468c-ba13-f32e048c0a17 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 May 09 10:09:49.575928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 794/1564] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:50.587340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:50.588275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:50.595158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:50.595616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:50.596393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:50.596874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:50.626727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5495baa0-dbb5-426d-b75e-16d3cd5c29fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043401 May 09 10:09:50.627281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 771/1565] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:51.638773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:51.639760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:51.646950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:51.647395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:51.648162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:51.648593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:51.678421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f80112d-b0ab-43f7-96ff-a4be7e0c99f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 May 09 10:09:51.678893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 795/1566] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:52.690304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:52.691225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:52.698193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:52.698654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:52.699433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:52.699875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:52.729848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e3af3679-67bf-4e36-89b3-c2781e6a2588 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 May 09 10:09:52.730476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 772/1567] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:53.741678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:53.742588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:53.749580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:53.750023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:53.750787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:53.751189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:53.781364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bddec42-9609-431f-8e68-3d79bb0378b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 May 09 10:09:53.781919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 796/1568] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:54.793472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:54.794402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:54.801236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:54.801715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:54.802480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:54.802913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:54.831800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-000b40d9-0731-4452-9cfe-6a4530add792 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042410 May 09 10:09:54.832271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 773/1569] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:55.843694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:55.844534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:55.851681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:55.852239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:55.853085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:55.853560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:55.883455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee93731d-0c91-4e59-848a-b66896b408e1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 May 09 10:09:55.884026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 797/1570] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:56.895572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:56.896597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:56.903388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:56.903841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:56.904629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:56.905105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:56.934845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a067188d-b756-4279-a219-674955a0f672 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 May 09 10:09:56.935406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 774/1571] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:57.946906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:57.948643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:57.955565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:57.956043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:57.956841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:57.957266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:57.986318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-295c5321-e287-4e38-b789-4fb03fff0679 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043533 May 09 10:09:57.986876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 798/1572] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:58.998536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:09:58.999468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:09:59.006301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:59.006755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:59.007532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:09:59.007967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:09:59.037816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f4ec275-0ac7-4115-a7bf-ad60c811e4cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 May 09 10:09:59.038382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 775/1573] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:09:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:09:59.248719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:09:59.249573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:10:00.050005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:00.050929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:00.057724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:00.058178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:00.058937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:00.059364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:00.089126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4640f04c-2ea0-4aac-a40a-812c4303cf0b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043150 May 09 10:10:00.089687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 799/1574] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:01.101753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:01.102719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:01.109486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:01.109955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:01.110730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:01.111175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:01.140984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d1b3ae8-ceab-4605-8d36-deae4d80f0f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 May 09 10:10:01.141546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 776/1575] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:02.152980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:02.153900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:02.160638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:02.161110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:02.161877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:02.162303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:02.191478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-973602c4-fd16-42a9-be18-05655052bcac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 May 09 10:10:02.192272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 800/1576] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:03.202671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:03.203592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:03.210358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:03.210811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:03.211582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:03.212017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:03.241910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ac5e517-8634-4efe-aa67-6022e4fcd870 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 May 09 10:10:03.242471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 777/1577] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:04.253871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:04.254793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:04.261659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:04.262099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:04.262871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:04.263303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:04.293507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54b4bd32-3218-41f1-8daa-c6fecf172e1e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043609 May 09 10:10:04.294074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 801/1578] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:05.305550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:05.306479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:05.313236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:05.313833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:05.314756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:05.315187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:05.344619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a0f6f25-7433-4873-b45a-e2959acc7f74 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 May 09 10:10:05.345211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 778/1579] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:06.356834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:06.357752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:06.364284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:06.364726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:06.365516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:06.365946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:06.395267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc036c94-3c71-4e4f-9c2c-07c652e920c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042442 May 09 10:10:06.396027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 802/1580] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:10:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:10:07.408801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:10:07.409851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:07.417738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:07.418186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:07.418963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:07.419378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:07.540735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84645ce4-1624-4957-ae5c-c6bc6b69e945 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/action" status: 200 len: 115969 microversion: 2.1 time: 0.134645 May 09 10:10:07.540735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 779/1581] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 10:10:07 2022] POST /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652/action => generated 115969 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:07.989096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:07.989685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:07.998407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:07.998857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:07.999659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.000070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.028379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:10:08.113833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-73fd2796-236f-403d-a645-80abd75b0d2c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 204 len: 0 microversion: 2.1 time: 0.128604 May 09 10:10:08.114415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 803/1582] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:10:07 2022] DELETE /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:10:08.123850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:08.124750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:08.132285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.132771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.133608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.134047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.347181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:08.347748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:08.353914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:08.354394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.354899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.355745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.356272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.362280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95389e99-74fd-454b-8951-c73d320e257c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.242950 May 09 10:10:08.362827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 780/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:08.381642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:10:08.464789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-61c9a12e-bbd0-41d1-b19f-75e6b60d2b4a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 204 len: 0 microversion: 2.1 time: 0.121377 May 09 10:10:08.465420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 804/1584] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:10:08 2022] DELETE /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:10:08.475067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:08.475687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:08.483185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.483642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.484418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.484937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.629909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:08.640238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fabea664-dccd-4021-9183-82f549cb9f5f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.169096 May 09 10:10:08.640908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 781/1585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:08.912832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:08.913660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:08.921856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.922299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.923063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:08.923488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:08.950609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:10:09.030353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1936123-f949-4656-9973-42ae5f58c007 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 204 len: 0 microversion: 2.20 time: 0.123979 May 09 10:10:09.031475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 805/1586] 10.222.0.26 () {60 vars in 1279 bytes} [Mon May 9 10:10:08 2022] DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 10:10:09.040205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:09.040961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:09.047406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:09.047863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:09.048642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:09.049115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:09.190075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:09.200546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:09.202068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:09.203251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8718dab1-9076-43af-abf4-98cd1eff7c49 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.167017 May 09 10:10:09.203812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 782/1587] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:09.383402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:09.384413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:09.393938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:09.394634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:09.395807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:09.396527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:09.618214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:09.627200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f2bcbaa-651f-4fc2-a522-9b38829804f3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.250964 May 09 10:10:09.627779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 806/1588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:09 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:09.662260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:09.662965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:09.669846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:09.670295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:09.671066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:09.671564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:09.817688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:09.826384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea40c3d6-c095-40ef-a3ab-eccdf58591fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168168 May 09 10:10:09.827289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 783/1589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:09.983019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-993e18dc-bf64-4aab-b559-14cb3a0dc156 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] Calling method '.version_select at 0x7fa45efb9ee0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:10.008411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-993e18dc-bf64-4aab-b559-14cb3a0dc156 tempest-TestVolumeBootPattern-1492144335 tempest-TestVolumeBootPattern-1492144335-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-199242016" status: 202 len: 0 microversion: 2.1 time: 0.029675 May 09 10:10:10.012751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 807/1590] 10.222.0.26 () {58 vars in 1259 bytes} [Mon May 9 10:10:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-199242016 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:10:10.224893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:10.225498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:10.232019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:10.232550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:10.233411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:10.233911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:10.466357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:10.475241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:10.477000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:10.478176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0831e6ae-5939-4045-a5fc-30f9985082d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.257333 May 09 10:10:10.478784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 784/1591] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:10.645313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:10.645960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:10.652902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:10.653352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:10.654123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:10.654549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:10.788576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:10.796821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1ddcdfa-2ad9-48a4-b4c2-c3988f6a84a8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155401 May 09 10:10:10.797410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 808/1592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:10 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:10.843523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:10.844119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:10.850733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:10.851504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:10.852279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:10.852705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:11.087185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:11.095621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70cc84e1-7dae-496d-9b25-a24bc64aebc5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.255899 May 09 10:10:11.096218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 785/1593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:10 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:11.497510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:11.498125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:11.504458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:11.504926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:11.505703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:11.506361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:11.647181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:11.656177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:11.657620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:11.658790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-528c756f-6bc2-468e-a6f8-d7fdbe216a12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165368 May 09 10:10:11.659356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 809/1594] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:11.814384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:11.815153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:11.821786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:11.822293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:11.823067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:11.823506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:12.113709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:12.114318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:12.121135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:12.121579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:12.122576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:12.123006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:12.264537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:12.273847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1aeb816f-0234-432c-bea0-5273f29b7194 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164015 May 09 10:10:12.274691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 810/1595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:12.295252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:12.303018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-271c2230-c7c5-4f06-b77a-11d9eeecf942 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.492505 May 09 10:10:12.303677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 786/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:11 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:12.682952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:12.683523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:12.690662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:12.691401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:12.692298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:12.692600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:12.848883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:12.859526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:12.861086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:12.862284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ebcd14e7-179e-413b-bca7-f1ee307bca4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.183453 May 09 10:10:12.863047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 811/1597] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:13.290905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:13.291498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:13.298049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:13.298651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:13.299264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:13.299687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:13.319537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:13.320300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:13.328843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:13.329292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:13.330060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:13.330490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:13.470813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:13.479484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ee134a5-ad50-4f9b-a97b-08ae6b9ec79c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163809 May 09 10:10:13.480066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 812/1598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:13 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:13.526868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:13.540625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a2317a3-7ba7-48cf-8f1b-a3144c3a6564 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.253417 May 09 10:10:13.541691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 787/1599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:13.884315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:13.886142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:13.898091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:13.898536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:13.899318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:13.899753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:14.080557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:14.089738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:14.091506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:14.092743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ba83afe-b768-4e81-b8eb-f3f6992ff2c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.213622 May 09 10:10:14.093610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 813/1600] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:14.497077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:14.497944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:14.504784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:14.505320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:14.506170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:14.506675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:14.558948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:14.559883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:14.566300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:14.566833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:14.567678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:14.568349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:14.643566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:14.651572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d06e82f-5670-462a-9d92-58dd1cca26ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158448 May 09 10:10:14.652237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 788/1601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:14 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:14.886390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:14.894721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9c07855b-8fe8-4d09-a597-85027cb5fb55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.340199 May 09 10:10:14.895230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 814/1602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:10:15.121091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:15.121915 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:15.128865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:15.129463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:15.130526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:15.131047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:15.268806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:15.278308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:15.279797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:15.281017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9aebd27d-0f84-4ee6-8d03-ccc7917e4054 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164232 May 09 10:10:15.281575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 789/1603] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:15.669380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:15.670143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:15.677426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:15.677426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:15.678334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:15.678990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:15.884762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:15.894526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-adcfddb5-ff7e-4034-b3f5-430353f8ed3f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.229604 May 09 10:10:15.895227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 815/1604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:15 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:15.911629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:15.912196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:15.919510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:15.919883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:15.920675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:15.921141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:16.049769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:16.059287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-02774f14-c2df-43d5-aa51-534472d0ce3b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151482 May 09 10:10:16.059881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 790/1605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:16.299488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:16.300093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:16.306300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:16.306826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:16.307600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:16.308022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:16.532020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:16.543631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:16.545583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:16.546784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-751fa166-dde2-4224-a757-017397ae31d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.251325 May 09 10:10:16.547379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 816/1606] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:16.911910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:16.912556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:16.919025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:16.919483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:16.920368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:16.920898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:17.059570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:17.067788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6343658b-57a7-4dcb-8db2-dbd96131db5c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160004 May 09 10:10:17.068374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 791/1607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:16 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:17.076491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:17.078054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:17.084896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:17.085350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:17.086136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:17.086574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:17.334760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:17.343383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d31c0803-b301-439d-b941-5b8f1ed5a19c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.270706 May 09 10:10:17.343972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 817/1608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:17 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:17.566343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:17.567192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:17.574526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:17.575066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:17.576219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:17.576348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:17.736562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:17.749839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:17.751387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:17.752603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63167e6d-934a-4ebb-97ff-fd43fc274a50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.190154 May 09 10:10:17.753193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 792/1609] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:18.085044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:18.085795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:18.092757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:18.093288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:18.094156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:18.094659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:18.265316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:18.274383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b1c9ec2-2ab1-4575-b893-8b9a0bf36c62 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.193281 May 09 10:10:18.275353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 818/1610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:18 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:18.361795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:18.362898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:18.370751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:18.371272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:18.372616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:18.373158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:18.507636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:18.515750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-72607aa1-14ec-485d-8872-9e64b4a2e4e8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157881 May 09 10:10:18.516327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 793/1611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:18 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:18.772081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:18.772725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:18.779609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:18.780200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:18.781240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:18.781676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:18.928905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:18.937831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:18.939323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:18.940588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b5ae422-6f41-4793-b2b1-93eacb9b6e8d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.172633 May 09 10:10:18.941328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 819/1612] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:19.293137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:19.293754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:19.300260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:19.300709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:19.301517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:19.301953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:19.433725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:19.442232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd239198-ed32-419d-9d23-82c9ba23399e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153635 May 09 10:10:19.442829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 794/1613] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:19 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:19.533554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:19.534160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:19.540969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:19.541419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:19.542196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:19.542632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:19.674856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:19.683374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97ab699c-3533-4666-a3b9-8d7f9d28ad48 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153679 May 09 10:10:19.684017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 820/1614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:19.959840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:19.960357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:19.966880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:19.967327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:19.968100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:19.968536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:20.104251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:20.115700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:20.117227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:20.118379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b5f9344-1806-4fc0-bf50-70bf074a6b05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162732 May 09 10:10:20.118947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 795/1615] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:20.459567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:20.460170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:20.468162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:20.468931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:20.469822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:20.470491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:20.606003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:20.614510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02861f2d-36ff-43f7-b703-4a58edb5743b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158838 May 09 10:10:20.615101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 821/1616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:20 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:20.701591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:20.702215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:20.709076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:20.709525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:20.710302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:20.710736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:20.846572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:20.855189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cdaf746-5987-4e01-aec3-d657e20a1244 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157437 May 09 10:10:20.855680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 796/1617] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:21.140307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:21.141069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:21.150942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:21.151382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:21.152183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:21.152611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:21.283626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:21.292931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:21.294426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:21.295603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-423c423b-c625-4975-a827-e64c8599f181 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.161809 May 09 10:10:21.296171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 822/1618] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:21.631519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:21.632127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:21.638794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:21.639244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:21.640023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:21.640436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:21.777603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:21.785681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7d46679-5092-46b5-bb2a-a9926fb9923b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158108 May 09 10:10:21.786347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 797/1619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:21 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:21.873683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:21.874323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:21.880964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:21.881409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:21.882155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:21.882581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:22.017596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:22.026112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b2e96b19-eb13-4a10-9541-d2ecaff97562 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156336 May 09 10:10:22.026700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 823/1620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:22.317971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:22.318925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:22.326482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:22.326933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:22.327696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:22.328124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:22.466216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:22.481550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:22.485012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:22.486823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6d4686d-3c83-43f7-ac2c-9e343374d991 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.174947 May 09 10:10:22.487749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 798/1621] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:22.802931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:22.803539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:22.810281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:22.810733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:22.811539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:22.811972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:22.946735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:22.960914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b2cd680-1704-4137-bcdd-85b83fe95564 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161421 May 09 10:10:22.961704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 824/1622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:22 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:23.046171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:23.046760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:23.053750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:23.054123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:23.054897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:23.055323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:23.184814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:23.200801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f8c0182-0da2-431f-aef0-7d8bc22006af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.160731 May 09 10:10:23.201391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 799/1623] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:23 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:23.506421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:23.506956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:23.513844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:23.514533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:23.515859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:23.516450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:23.655202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:23.663613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:23.665135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:23.666434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10f35f27-2ac3-43ef-a317-a6084dd4b759 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164257 May 09 10:10:23.667001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 825/1624] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:23.987045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:23.987641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:23.994281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:23.994727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:23.995493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:23.995924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:24.146717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:24.155086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1792e26-d2f0-4403-8a58-8f6c9e5b0ce0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.171937 May 09 10:10:24.155630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 800/1625] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:23 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:24.218881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:24.219457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:24.226332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:24.226840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:24.227791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:24.228219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:24.369069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:24.377278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-feb6ad10-bd8d-4667-b80a-91c9cfcdcda7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162425 May 09 10:10:24.377857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 826/1626] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:24 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:24.687165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:24.687938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:24.694340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:24.694791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:24.695572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:24.696008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:24.833200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:24.842957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:24.844497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:24.845716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aeba4769-1e29-4c7b-8232-1a86c9e3a3e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162607 May 09 10:10:24.846290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 801/1627] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:25.173605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:25.174122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:25.182327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:25.182949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:25.184196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:25.184930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:25.320519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:25.329586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84fb0655-f176-4a38-b937-e3274410dcd5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160464 May 09 10:10:25.330182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 827/1628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:25 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:25.398275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:25.398857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:25.405753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:25.406211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:25.406998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:25.407421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:25.536213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:25.544695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cc3af793-81d7-4349-a04d-899bb9667919 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150362 May 09 10:10:25.545251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 802/1629] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:25.864985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:25.865573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:25.872431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:25.872899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:25.873682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:25.874164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:26.014414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:26.023220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:26.024922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:26.025900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1e7b71c4-fa16-415e-a65e-74f76dfe7567 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165075 May 09 10:10:26.026478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 828/1630] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:26.346740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:26.347345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:26.354346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:26.354789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:26.355564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:26.355995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:26.498906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:26.507269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ceb4bff-9234-4506-98ae-614659e7bcaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.164370 May 09 10:10:26.507912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 803/1631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:26 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:26.563229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:26.563887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:26.571547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:26.572049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:26.572891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:26.573323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:26.712184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:26.723009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3cbb715f-e9f8-4382-bc25-2481d0fd2596 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164918 May 09 10:10:26.723740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 829/1632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:27.045341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:27.045962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:27.052832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:27.053511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:27.054480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:27.054937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:27.187356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:27.197029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:27.198527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:27.199694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e16d2cb-1bad-47ac-9549-25995241230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158411 May 09 10:10:27.200254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 804/1633] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:27.526209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:27.526730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:27.533448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:27.533880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:27.534641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:27.535083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:27.669387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:27.680713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dbf63637-c864-4f67-8e32-bf3b61720cb5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158451 May 09 10:10:27.681377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 830/1634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:27 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:27.741384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:27.742026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:27.749303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:27.749752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:27.750529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:27.750964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:27.884439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:27.892364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3cb661ec-aa41-4605-b622-5854bc0aacd1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154879 May 09 10:10:27.892973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 805/1635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:28.222662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:28.223304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:28.230355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:28.230834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:28.231924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:28.232372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:28.361872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:28.371045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:28.372575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:28.373876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e5b3a14-5083-4da1-8107-70c643e1cd61 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.155309 May 09 10:10:28.374454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 831/1636] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:28.701480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:28.702014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:28.708691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:28.709142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:28.709914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:28.710347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:28.839427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:28.848562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c0deaed0-91d7-46dd-9e24-5e1d9042ea9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153420 May 09 10:10:28.849190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 806/1637] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:28 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:28.909624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:28.910260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:28.917145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:28.917593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:28.918330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:28.918757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:29.047795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:29.056211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9cbb50b0-0294-40aa-9a18-6b3dfedfb698 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150448 May 09 10:10:29.056819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 832/1638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:28 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:29.396779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:29.397879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:29.405212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:29.405660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:29.406423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:29.406849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:29.552192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:29.561022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:29.562503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:29.563674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8560d246-7958-4220-ad4d-2dd76034f9df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.173470 May 09 10:10:29.564232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 807/1639] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:29.866573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:29.867183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:29.873751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:29.874203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:29.874981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:29.875418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:30.009053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:30.017031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-33c04510-6540-4953-96cd-4c844ec30b78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154468 May 09 10:10:30.017607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 833/1640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:29 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:30.073346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:30.073929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:30.080842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:30.081361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:30.082411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:30.083244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:30.214328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:30.222612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9dd02750-b0c4-4b61-a97f-a058f4023bc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153134 May 09 10:10:30.223230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 808/1641] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:30 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:30.584371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:30.585309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:30.595078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:30.595742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:30.597185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:30.597816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:30.728911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:30.737741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:30.739245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:30.740417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94426943-81f3-4955-a4fc-c9fe57f7251a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160789 May 09 10:10:30.741092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 834/1642] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:31.034549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:31.035151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:31.041836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:31.042285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:31.043048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:31.043476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:31.170897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:31.179219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4f46e5bf-524a-4bec-a7d1-5ba27a8d9f2a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.148547 May 09 10:10:31.179761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 809/1643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:31 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:31.240329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:31.240906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:31.247661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:31.248111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:31.248918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:31.249357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:31.380264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:31.388925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74e3a1db-7db5-417e-810a-ad7a7630aacb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152516 May 09 10:10:31.389501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 835/1644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:31 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:31.760423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:31.762108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:31.769976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:31.770430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:31.771208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:31.771767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:31.905200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:31.913938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:31.915527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:31.916685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa223f9b-d4f0-41d9-8e96-93ef553d092e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160918 May 09 10:10:31.917273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 810/1645] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:32.196573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:32.197205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:32.203761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:32.204210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:32.205001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:32.205427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:32.335480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:32.343545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b28e588-9643-4bf2-b031-d76ff6cbe49c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151385 May 09 10:10:32.344122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 836/1646] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:32 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:32.408170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:32.408779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:32.415467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:32.415917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:32.416710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:32.417151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:32.545147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:32.553372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd72af7f-4c82-4714-b909-98e350ff9550 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150868 May 09 10:10:32.553928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 811/1647] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:32 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:32.935684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:32.936309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:32.942897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:32.943344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:32.944114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:32.944546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:33.073799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:33.082607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:33.084322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:33.085559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba7abf17-2c5c-458f-b8bf-f1d898480d66 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153850 May 09 10:10:33.086155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 837/1648] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:33.360893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:33.361502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:33.368288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:33.368778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:33.369546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:33.369975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:33.503887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:33.512357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c09834d0-c4c4-4493-85c9-14a8ee8590c2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155432 May 09 10:10:33.512978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 812/1649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:33 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:33.571223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:33.571947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:33.578727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:33.579172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:33.579925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:33.580353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:33.708544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:33.716996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-32f693f4-1248-4985-8571-4ca860319625 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149677 May 09 10:10:33.717567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 838/1650] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:33 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:34.104954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:34.105559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:34.112093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:34.112530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:34.113332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:34.113764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:34.240154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:34.248587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:34.250120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:34.251280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f6f55998-a3f0-4692-b140-ac6ad6f579cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.150839 May 09 10:10:34.251841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 813/1651] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:34.530149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:34.530755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:34.537218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:34.537657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:34.538422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:34.538850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:34.673943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:34.682477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0a9a3f9c-0688-4a45-b0c3-15179a5cc66a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156256 May 09 10:10:34.683063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 839/1652] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:34.734636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:34.735278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:34.741962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:34.742411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:34.743162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:34.743690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:34.870864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:34.878859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-caf42534-0882-4d72-95f4-44d9821139eb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.148146 May 09 10:10:34.879405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 814/1653] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:34 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:35.269853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:35.270554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:35.276642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:35.277115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:35.277876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:35.278286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:35.409301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:35.417869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:35.419526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:35.420696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3a4782d-b984-496e-9d49-8c965709fd00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154840 May 09 10:10:35.421270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 840/1654] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:10:35.699757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:35.700376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:35.706906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:35.707356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:35.708126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:35.708565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:35.838654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:35.846975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c41f7dbd-2a85-4f59-a9f4-f6c0f474fcb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151248 May 09 10:10:35.847522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 815/1655] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:35 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:35.895695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:35.896352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:35.903311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:35.903762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:35.904532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:35.905002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:36.032829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:36.041437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d86da22f-5245-4a0b-8fbd-9eb82eca1794 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149706 May 09 10:10:36.041921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 841/1656] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:35 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:36.439786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:36.440336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:36.447069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:36.447544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:36.448341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:36.448837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:36.578480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:36.587277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:36.588810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:36.590017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-366f22fb-a9ae-446e-a5b4-4d5c65e83ccf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154449 May 09 10:10:36.590574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 816/1657] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:36.865168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:36.865801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:36.872195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:36.872647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:36.873438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:36.873869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:37.008786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:37.016713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-894694fe-0bd9-41da-9253-ebbf8195ef76 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155494 May 09 10:10:37.017314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 842/1658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:36 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:37.059006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:37.059614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:37.066517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:37.066978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:37.067782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:37.068223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:37.200873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:37.209572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0125f145-edde-4517-bcbb-f4269b191652 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154675 May 09 10:10:37.210153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 817/1659] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:37.609429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:37.610026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:37.616222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:37.616681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:37.617583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:37.618131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:37.746088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:37.757468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:37.758965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:37.760122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17bf5d43-84b8-4fe4-858a-360ee6044099 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154802 May 09 10:10:37.760687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 843/1660] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:38.034633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:38.035256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:38.041513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:38.041968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:38.042746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:38.043176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:38.175657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:38.183866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bac8a79d-6661-489d-9a89-25800e75b2ff tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153303 May 09 10:10:38.184437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 818/1661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:38 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:38.227808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:38.228402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:38.235167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:38.235667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:38.236436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:38.236931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:38.369661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:38.378342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6eb3e0db-f097-4599-bcf8-5c6357c1e162 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154789 May 09 10:10:38.378999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 844/1662] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:38 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:38.779377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:38.779985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:38.786492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:38.786942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:38.787730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:38.788187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:38.918506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:38.928002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:38.930715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:38.932413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4003a28-1122-4021-953b-8eb4375eb893 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157061 May 09 10:10:38.933024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 819/1663] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:39.201606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:39.202551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:39.208627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:39.209111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:39.209883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:39.210315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:39.341849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:39.350345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23bd9040-b9b6-4c84-89ff-762064913dd1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152708 May 09 10:10:39.351230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 845/1664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:39.395498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:39.396239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:39.402844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:39.403305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:39.404075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:39.404647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:39.606100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:39.614335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adc4ce78-4744-4852-bb0a-32bd1c091f2b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.222734 May 09 10:10:39.614908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 820/1665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:39.951882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:39.952422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:39.959196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:39.959639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:39.960409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:39.960883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:40.091818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:40.101037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:40.102593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:40.103763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74fbc9c9-4a3e-43ed-bbab-8c9c28da05ab tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.156014 May 09 10:10:40.104376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 846/1666] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:40.367823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:40.368429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:40.374813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:40.375257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:40.376020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:40.376449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:40.519264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:40.527393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c593133a-1034-4571-8a8f-172d85edf649 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163361 May 09 10:10:40.527921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 821/1667] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:40 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:40.631826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:40.632448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:40.639395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:40.639844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:40.640613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:40.641097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:40.776298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:40.784422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b16b6d93-435e-4c2b-992d-9483dba07358 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156652 May 09 10:10:40.785046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 847/1668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:41.122631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:41.123235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:41.129823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:41.130265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:41.131025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:41.131451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:41.256999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:41.265352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:41.266844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:41.268003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9ac6b1b-5371-4033-afff-17feb0419e48 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.149358 May 09 10:10:41.268559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 822/1669] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:41.544834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:41.545445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:41.551654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:41.552103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:41.552910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:41.553339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:41.685553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:41.693872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d3ce7d60-86af-4817-8f51-3c2f0cc08594 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153011 May 09 10:10:41.694448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 848/1670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:41 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:41.801966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:41.802605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:41.809344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:41.809790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:41.810572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:41.810993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:41.938754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:41.946820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbeb707b-ea41-4dec-8b2f-158fa2398703 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.148710 May 09 10:10:41.947386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 823/1671] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:42.286393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:42.287002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:42.293722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:42.294171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:42.294942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:42.295372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:42.424605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:42.433433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:42.434931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:42.436098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b380407-456d-4326-bdfd-28f2da74fc06 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153726 May 09 10:10:42.436637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 849/1672] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:42.711757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:42.712347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:42.719178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:42.719634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:42.720405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:42.720880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:42.963861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:42.964445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:42.972142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:42.972588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:42.973424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:42.973853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:43.099852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:43.101450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:43.108418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ae2b4d0-81df-45cd-8755-3366c6d83c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.400781 May 09 10:10:43.109029 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 824/1673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:42 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:43.109159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-175c7c94-4f81-49c4-938a-b9bec038244c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149470 May 09 10:10:43.109690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 850/1674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:42 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:43.455499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:43.456136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:43.462932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:43.463387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:43.464166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:43.464602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:43.593664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:43.602410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:43.603920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:43.605119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fdcd9417-fd8d-439f-b4a4-0228075db4c0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153793 May 09 10:10:43.605696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 825/1675] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:44.125835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:44.126440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:44.126852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:44.126962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:44.133352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:44.133579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:44.133873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:44.134019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:44.134646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:44.134786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:44.135083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:44.135244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:44.264861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:44.267894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:44.273422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-388672c6-e0b1-4f90-906b-d2860aa0820a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151497 May 09 10:10:44.274009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 851/1676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:44 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:44.276115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d360a19b-ff85-4cf8-b927-2ffd748529dc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154088 May 09 10:10:44.276726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 826/1677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:44.623232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:44.623832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:44.630307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:44.630750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:44.631510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:44.631938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:44.768637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:44.777235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:44.778718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:44.779877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f913034-b2b7-43eb-a270-ec7cfdeae400 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160696 May 09 10:10:44.780464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 852/1678] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:45.291503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:45.292136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:45.293138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:45.293763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:45.299034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:45.299505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:45.300325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:45.300787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:45.300927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:45.301236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:45.301980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:45.302427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:45.430864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:45.431153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:45.439039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d68d1f82-30cb-4df3-ae7a-fa5e284ec9af tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151586 May 09 10:10:45.439245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9af46172-7f3a-4f9d-a2a5-67643f001b28 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149869 May 09 10:10:45.439595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 827/1679] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:45 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:45.439753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 853/1680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:45.798898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:45.799501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:45.806037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:45.806499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:45.807259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:45.807685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:45.940811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:45.950105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:45.951607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:45.952888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25360ee6-a6be-42f4-8613-d896a3e8514b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157898 May 09 10:10:45.953589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 828/1681] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:46.455818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:46.456410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:46.456687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:46.457343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:46.463406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:46.463881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:46.464685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:46.464832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:46.465135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:46.465293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:46.465949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:46.466367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:46.597217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:46.598364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:46.605864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e7ce92fe-d254-430a-9509-82d8f70c907d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154211 May 09 10:10:46.606404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee226e82-8ca1-49c8-a39d-ad811d059d0a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153615 May 09 10:10:46.606544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 854/1682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:46.606993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 829/1683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:46.972266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:46.972903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:46.979859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:46.980321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:46.981136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:46.981570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:47.113449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:47.122182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:47.123671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:47.124949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dac65584-bfb9-4c8a-ba95-94b0ea216c32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.156655 May 09 10:10:47.125493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 855/1684] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:47.623392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:47.624265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:47.624265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:47.624805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:47.630786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:47.631022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:47.631245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:47.631397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:47.632039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:47.632183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:47.632475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:47.632649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:47.760314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:47.761613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:47.768484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-67f6ca36-c8ae-4269-8ff7-671a33bf5de5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.148959 May 09 10:10:47.769183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 856/1685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:47 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:47.769623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-deb6c970-bc9e-4328-aab4-5c065ccc360b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150205 May 09 10:10:47.770212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 830/1686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:47 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:48.143444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:48.144051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:48.150398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:48.150842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:48.151605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:48.152007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:48.291001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:48.299805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:48.301414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:48.302646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-993a9d4a-1a97-4a7d-8a9e-e24b9c7c01b4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163137 May 09 10:10:48.303190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 857/1687] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:48.786093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:48.786789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:48.787165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:48.787289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:48.793544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:48.793754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:48.793996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:48.794155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:48.794773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:48.794917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:48.795209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:48.795353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:48.932150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:48.932343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:48.940303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e46226a2-d70a-4a4d-9dd4-a564f88216b7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.158031 May 09 10:10:48.940513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ce72ff2-5ff2-49ab-a937-2d36b32f7f4e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158101 May 09 10:10:48.940866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 858/1689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:48 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:48.941221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 831/1689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:48 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:49.322217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:49.322839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:49.329431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:49.329884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:49.330662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:49.331099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:49.459023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:49.468263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:49.469829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:49.471009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d9fa19d-80cd-493f-aa6c-853a3dc28f4d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153061 May 09 10:10:49.471592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 832/1690] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:49.957589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:49.958235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:49.958690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:49.958793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:49.964882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:49.965315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:49.966200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:49.966652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:49.966904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:49.967416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:49.968327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:49.969399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:50.103664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:50.112164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51e797f2-f13f-4766-93bb-4a5e5c835007 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.158420 May 09 10:10:50.112892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 833/1691] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:50.351856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:50.361855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce89d5d8-f5d7-4f07-9dc6-10a42997950b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.408069 May 09 10:10:50.362639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 859/1692] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:49 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:50.490529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:50.491042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:50.499114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:50.499803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:50.501133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:50.501744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:50.639827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:50.649030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:50.650538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:50.651704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3d163f5-f471-4aa5-bc1b-a38ad53de87d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165335 May 09 10:10:50.652234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 834/1693] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:51.130155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:51.130783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:51.137588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:51.138032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:51.138792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:51.139221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:51.269427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:51.278086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb851476-741e-4dbc-9756-f95fd53a2690 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151878 May 09 10:10:51.278663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 860/1694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:51.380925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:51.381624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:51.388123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:51.388564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:51.389345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:51.389773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:51.519177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:51.527202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a42b81cb-9850-4f09-b2c3-ba1c7a64607b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150315 May 09 10:10:51.527746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 835/1695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:51 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:51.671105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:51.671718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:51.678283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:51.678733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:51.679496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:51.679934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:51.814873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:51.823514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:51.825051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:51.826225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5252997b-1806-47f1-9a16-647f24fdbae9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159182 May 09 10:10:51.826794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 861/1696] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:52.295875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:52.296512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:52.303071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:52.303525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:52.304334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:52.304816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:52.442664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:52.450736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0cf5e4a7-1deb-4aa5-841f-9f41ff3c3514 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.158915 May 09 10:10:52.451342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 836/1697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:52 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:52.544780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:52.545382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:52.552169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:52.552620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:52.553405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:52.553832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:52.683403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:52.691706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6d53051e-b527-4b69-a1a3-f151fb183036 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150830 May 09 10:10:52.692280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 862/1698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:52 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:52.844645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:52.845275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:52.852036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:52.852521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:52.853307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:52.853738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:52.983001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:52.991759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:52.993298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:52.994453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-279996c5-5d4e-4b44-8806-e181cbe73302 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153728 May 09 10:10:52.995018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 837/1699] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:53.467771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:53.468369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:53.474937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:53.475694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:53.476462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:53.476939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:53.606858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:53.614833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e86574e-adfe-4414-98b6-a3920cad6568 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151174 May 09 10:10:53.615420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 863/1700] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:53.709178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:53.709747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:53.716589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:53.717068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:53.717838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:53.718273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:53.850630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:53.858799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7b7b68b-72ac-437a-93f2-8ea7b51f0ca8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153666 May 09 10:10:53.859367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 838/1701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:53 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:54.013458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:54.013998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:54.020560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:54.021042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:54.021809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:54.022244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:54.167684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:54.177302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:54.178811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:54.179990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de5b8a89-a306-4f81-8eec-46e82d70d87b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.170570 May 09 10:10:54.180654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 864/1702] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:54.632345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:54.633009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:54.639564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:54.640011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:54.640823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:54.641256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:54.768102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:54.776064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b2291caf-9da1-4b99-b40d-9c2effcf0b21 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.147626 May 09 10:10:54.776607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 839/1703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:54.876409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:54.877029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:54.883993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:54.884434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:54.885237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:54.885667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:55.013803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:55.021951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e0213a3a-c118-4791-ad24-f334387e1657 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.149518 May 09 10:10:55.022516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 865/1704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:54 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:55.199081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:55.199682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:55.206233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:55.206681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:55.207438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:55.207869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:55.346179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:55.355441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:55.356961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:55.358114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-82ec3429-05bd-44fe-ac15-726a41605b85 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163120 May 09 10:10:55.358665 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 840/1705] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:55.793982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:55.794619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:55.801132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:55.801515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:55.802284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:55.802750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:55.934641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:55.942536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42845fb0-a4a8-4e23-bf72-e770cab2e874 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152782 May 09 10:10:55.943076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 866/1706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:55 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:56.040754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:56.041388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:56.048201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:56.048658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:56.049487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:56.049927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:56.184423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:56.192838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7cf13445-ab8d-4ca8-8e8f-93f5d71cbeac tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156224 May 09 10:10:56.193415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 841/1707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:56 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:56.377285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:56.378001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:56.384403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:56.384830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:56.385639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:56.386125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:56.516200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:56.525573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:56.527134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:56.528342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-164b7658-e2d7-4b11-bd35-dda1088f7bb3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.155281 May 09 10:10:56.528987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 867/1708] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:56.960863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:56.961539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:56.968010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:56.968453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:56.969245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:56.969674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:57.096404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:57.104963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d18c85a-a8c7-4364-b208-10c14a16713e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.148010 May 09 10:10:57.105529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 842/1709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:57.210987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:57.211656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:57.218463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:57.218922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:57.219696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:57.220135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:57.354535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:57.362600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-401b66e4-b30c-45f0-9a60-abe4d9047c41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155949 May 09 10:10:57.363213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 868/1710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:57 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:57.547746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:57.548364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:57.555054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:57.555498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:57.556275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:57.556768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:57.690152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:57.698838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:57.700467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:57.701699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-507f020f-8a25-4065-b14c-addf65d128af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157994 May 09 10:10:57.702313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 843/1711] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:58.122411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:58.123037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:58.129491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:58.129937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:58.130707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:58.131145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:58.261714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:58.270192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16b6155f-4702-43b0-9427-95cda53dede4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151724 May 09 10:10:58.270768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 869/1712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:58 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:58.380232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:58.380976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:58.388055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:58.388503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:58.389337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:58.389765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:58.519715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:58.528289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c0d8d63-e28b-4a82-9af1-9a10194ca855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152040 May 09 10:10:58.528871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 844/1713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:58 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:58.719411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:58.720027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:58.726790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:58.727210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:58.727974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:58.728408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:58.857772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:58.867253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:58.868761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:58.870341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ecfbf107-9f14-4ec9-94c5-208bd4b4bb93 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154676 May 09 10:10:58.870931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 870/1714] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:10:59.287664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:59.288266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:59.294870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:59.295296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:59.296056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:59.296483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:59.431903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:59.440131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-306fff3f-6c6c-4618-885e-b7f1673af8d5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156412 May 09 10:10:59.440724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 845/1715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:59.546105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:59.546665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:59.553500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:59.553948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:59.554722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:59.555211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:59.693515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:10:59.701839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f93bae1-a32b-4d53-97f5-cb2f59b97ac4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159794 May 09 10:10:59.702390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 871/1716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:10:59 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:10:59.889684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:10:59.890222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:10:59.896577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:59.897055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:10:59.897816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:10:59.898244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:00.032300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:00.040704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:00.042234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:00.043394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20dbec75-f3fa-4445-ac28-46af56b0c44e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157793 May 09 10:11:00.043953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 846/1717] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:10:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:00.457614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:00.458139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:00.464578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:00.465063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:00.465828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:00.466267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:00.596006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:00.604843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ad11ec6-f7a5-4bec-88c2-35bafb84eeaf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151361 May 09 10:11:00.605411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 872/1718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:00 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:00.719391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:00.719982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:00.727062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:00.727508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:00.728270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:00.728699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:00.863224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:00.871505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-782ed1e2-ecd5-47f9-bc61-fd0111b35cde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156104 May 09 10:11:00.872072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 847/1719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:00 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:01.062363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:01.062981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:01.069630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:01.070082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:01.071021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:01.071451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:01.211194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:01.219863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:01.221399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:01.222574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1acb596e-fe74-4bd6-a052-bf2324be642d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164267 May 09 10:11:01.223157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 873/1720] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:01.622483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:01.623120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:01.629716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:01.630161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:01.630953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:01.631378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:01.765662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:01.774075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13bd3a08-821e-4ffe-a78b-8b0a57a89f43 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155587 May 09 10:11:01.774651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 848/1721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:01.888882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:01.889524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:01.896054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:01.896506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:01.897302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:01.897737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:02.031071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:02.039676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9af7c3bb-49c1-4733-b5b9-6cac58ad5ca5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154796 May 09 10:11:02.040254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 874/1722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:01 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:02.241836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:02.242524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:02.249053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:02.249507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:02.250280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:02.250711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:02.380058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:02.389310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:02.390817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:02.391990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b0f914c1-d9b5-41c6-ab04-904d8f0de50a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154128 May 09 10:11:02.392566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 849/1723] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:02.791647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:02.792403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:02.800143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:02.800601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:02.801389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:02.801819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:02.930882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:02.939131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72bcfb80-f649-42b8-85ca-000c5b97b1c1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151496 May 09 10:11:02.939684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 875/1724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:03.056827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:03.057439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:03.064307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:03.064785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:03.065547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:03.065974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:03.204921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:03.213557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ebf91eb1-e99b-41b4-8d5e-85727b1f1545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160743 May 09 10:11:03.214379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 850/1725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:03 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:03.411191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:03.411747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:03.418507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:03.419003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:03.419749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:03.420188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:03.556744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:03.564023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:03.565602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:03.566798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04b54dc6-eec9-47a3-892d-f4b56390bb51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159724 May 09 10:11:03.567365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 876/1726] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:03.955427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:03.956189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:03.962430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:03.962905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:03.963806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:03.964238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:04.092579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:04.101504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9fe2fd1-7a3f-4ddb-b4ee-c83d25cbd49c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149977 May 09 10:11:04.102086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 851/1727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:04.231368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:04.231876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:04.238650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:04.239095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:04.239859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:04.240285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:04.372960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:04.380857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e48b318d-129d-457d-bd52-e9477cd26294 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153471 May 09 10:11:04.381425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 877/1728] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:04 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:04.586055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:04.586704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:04.593397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:04.593849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:04.594629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:04.595074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:04.727557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:04.736495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:04.738045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:04.739203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d207ec65-158e-4e5b-8b91-d5007e9e3fbb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157349 May 09 10:11:04.739770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 852/1729] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:05.118920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:05.119537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:05.126076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:05.126527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:05.127300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:05.127737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:05.262522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:05.270423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea263a9d-d05c-494f-ba0f-0cf0278a9dae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155486 May 09 10:11:05.270985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 878/1730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:05 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:05.401355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:05.401924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:05.409049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:05.409497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:05.410265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:05.410727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:05.546233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:05.554264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-728f7a48-8285-4491-9696-e5fb35b8093e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158039 May 09 10:11:05.554872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 853/1731] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:05 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:05.759647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:05.760261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:05.767106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:05.767564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:05.768342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:05.768813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:05.901901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:05.910701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:05.912182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:05.913375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ef0d860-247c-437e-b555-c369923a8ad7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157788 May 09 10:11:05.913944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 879/1732] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:06.287929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:06.288545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:06.295253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:06.295742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:06.296529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:06.296998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:06.426719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:06.434711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7a8b01d-9e57-4319-8070-77b05af182c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150702 May 09 10:11:06.435291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 854/1733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:06.572154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:06.572747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:06.579639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:06.580087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:06.580893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:06.581326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:06.718800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:06.727546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-01ea4b52-d542-4e86-b76b-dd01cc955854 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159473 May 09 10:11:06.728163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 880/1734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:06 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:06.932801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:06.933346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:06.939876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:06.940326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:06.941141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:06.941580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:07.075049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:07.083878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:07.085389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:07.086595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d38d9ea3-e122-4ac1-9542-17074f648d13 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158041 May 09 10:11:07.087149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 855/1735] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:07.452292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:07.452926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:07.459349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:07.459790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:07.460552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:07.461109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:07.590954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:07.599189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5c1178e-72be-4780-bc86-d79659574e8e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150992 May 09 10:11:07.599797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 881/1736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:07 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:07.745518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:07.746080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:07.752947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:07.753405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:07.754210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:07.754648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:07.883312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:07.891363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99370f6c-352f-4ab3-8bae-8ea85206e5e5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.149958 May 09 10:11:07.891900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 856/1737] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:07 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:08.105986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:08.106591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:08.112952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:08.113397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:08.114150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:08.114578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:08.246267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:08.255219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:08.256750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:08.257955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7839e9a4-d66c-4d3f-9caa-e4577f48a4d7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.156033 May 09 10:11:08.258522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 882/1738] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:08.616251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:08.616925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:08.623446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:08.623888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:08.624688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:08.625125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:08.753754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:08.762256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a77b6f0f-da28-415d-8918-b085651a18d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149918 May 09 10:11:08.762830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 857/1739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:08.909439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:08.909995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:08.916694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:08.917243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:08.918016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:08.918449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:09.066373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:09.074958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a22ce1d3-8e07-4957-8dd1-d84046dbed5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.169729 May 09 10:11:09.075536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 883/1740] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:09.279949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:09.280936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:09.290856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:09.291311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:09.292117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:09.292553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:09.424085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:09.432949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:09.434459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:09.435647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf8e50e1-ffa9-401c-afc2-5b563849429f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162241 May 09 10:11:09.436217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 858/1741] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:09.779609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:09.780220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:09.786947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:09.787397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:09.788167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:09.788568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:09.915341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:09.924244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-91fc40c0-7a4d-4732-b5e5-ed7eb5d5293b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.148515 May 09 10:11:09.924956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 884/1742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:10.091894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:10.092520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:10.099414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:10.099864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:10.100981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:10.101711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:10.234138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:10.242419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ab64276-0389-4167-aec2-7a8fa9545afc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154450 May 09 10:11:10.242998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 859/1743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:10 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:10.454714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:10.455231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:10.461947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:10.462401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:10.463199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:10.463622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:10.599239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:10.608203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:10.609749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:10.610886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64ee6766-4bcb-4e41-9d5a-1f3a06bf25d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160247 May 09 10:11:10.611456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 885/1744] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:10.943545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:10.944162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:10.950835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:10.951284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:10.952058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:10.952490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:11.094855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:11.103824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44f31507-e94b-41fd-89b3-f6d8ac3b6243 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164197 May 09 10:11:11.104458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 860/1745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:10 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:11.259622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:11.260326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:11.267132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:11.267569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:11.268339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:11.268826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:11.400427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:11.409070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6f06191-cce0-464a-85a5-781ece8df948 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153315 May 09 10:11:11.409652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 886/1746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:11 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:11.629739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:11.630337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:11.636906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:11.637353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:11.638112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:11.638543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:11.765077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:11.774184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:11.775670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:11.776860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37a1c84e-36a6-467c-abde-092336b0def3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.151093 May 09 10:11:11.777416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 861/1747] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:12.121229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:12.121962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:12.128720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:12.129247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:12.130066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:12.130504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:12.262786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:12.271189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2da6c849-86ec-4ce8-b9ac-f33792360dc8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153988 May 09 10:11:12.271767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 887/1748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:12.426973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:12.427606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:12.434391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:12.434835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:12.435644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:12.436070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:12.575031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:12.583762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9256fa6d-8c48-4795-822e-21e5bced78a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160709 May 09 10:11:12.584311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 862/1749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:12 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:12.795943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:12.796549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:12.803176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:12.803623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:12.804485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:12.804957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:12.941989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:12.950880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:12.952364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:12.953577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c6f56ea-126e-4ef8-a4aa-c9cb37d2f3bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.161677 May 09 10:11:12.954115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 888/1750] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:13.288768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:13.289508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:13.296121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:13.296601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:13.297404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:13.297838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:13.430439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:13.438920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9e3d80b-dd7d-4051-881b-73ebad8388c0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154038 May 09 10:11:13.439645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 863/1751] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:13.602068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:13.602703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:13.609579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:13.610041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:13.610808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:13.611237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:13.740769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:13.749081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-828c9184-214e-4108-b1ac-e642210376b0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152073 May 09 10:11:13.749662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 889/1752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:13 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:13.972654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:13.973184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:13.980349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:13.980818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:13.981582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:13.982008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:14.117889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:14.126209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:14.127696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:14.128876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d513f2c9-154d-4787-993e-1c859a0d8e4a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160350 May 09 10:11:14.129435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 864/1753] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:14.455919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:14.456548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:14.463366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:14.463711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:14.464473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:14.464938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:14.595918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:14.604982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c51d6315-142a-4f0f-964b-35d03309ace2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152952 May 09 10:11:14.605612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 890/1754] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:14.766800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:14.767353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:14.774014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:14.774464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:14.776940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:14.777384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:14.920809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:14.928889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3a541bdf-6353-4d33-9b6f-17705d4399dc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.166150 May 09 10:11:14.929530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 865/1755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:14 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:15.147979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:15.148698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:15.155594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:15.156055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:15.156858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:15.157293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:15.296910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:15.305673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:15.307178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:15.308343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-638c7634-67f0-46ac-b8b1-25b5ea11e3fe tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164444 May 09 10:11:15.309283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 891/1756] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:15.623169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:15.623785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:15.630615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:15.631071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:15.631881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:15.632317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:15.764772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:15.772882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6313791d-6b4b-4413-92e4-5b80f7a0453b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153826 May 09 10:11:15.773589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 866/1757] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:15.946710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:15.947329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:15.953765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:15.954206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:15.954965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:15.955393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:16.089429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:16.097736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ba18ad8-04a8-4537-bec1-f1cd70a2555b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154992 May 09 10:11:16.098313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 892/1758] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:15 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:16.326412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:16.327055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:16.333572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:16.334004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:16.334829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:16.335267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:16.470467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:16.479934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:16.481480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:16.482652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a1bd365-e3c4-4cae-a0d3-106bbe68de1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160314 May 09 10:11:16.483225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 867/1759] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:16.790665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:16.791300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:16.798188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:16.798697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:16.799736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:16.800337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:16.930757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:16.939009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2f5a428-5af2-468d-8716-41936918523a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152431 May 09 10:11:16.939568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 893/1760] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:16 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:17.115448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:17.116049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:17.125085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:17.125534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:17.126318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:17.126753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:17.254414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:17.262819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df25f0e4-bf9a-4d29-8cda-f2854fdf0245 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151400 May 09 10:11:17.263403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 868/1761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:17 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:17.501664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:17.502260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:17.508653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:17.509123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:17.509894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:17.510350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:17.639214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:17.648035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:17.649784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:17.651045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1929cbf-5c6d-449f-9316-4fbe119da5d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153373 May 09 10:11:17.651620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 894/1762] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:17.961374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:17.961996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:17.968530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:17.969014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:17.969787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:17.970231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:18.103618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:18.111813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbbeb08d-d130-4a7b-a76e-08ff65374ffe tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154468 May 09 10:11:18.112394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 869/1763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:17 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:18.280381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:18.280943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:18.287926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:18.288371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:18.289293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:18.289733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:18.434874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:18.442969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db24d053-aef1-4764-b21d-25725e8049ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.166557 May 09 10:11:18.443556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 895/1764] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:18 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:18.670384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:18.670989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:18.677742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:18.678189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:18.678951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:18.679474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:18.809829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:18.818430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:18.820261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:18.821638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c0ffbeeb-876e-434e-821d-6a0c371709bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.155245 May 09 10:11:18.822382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 870/1765] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:19.130110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:19.130715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:19.137288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:19.137730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:19.138502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:19.138935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:19.280943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:19.289294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c72d26b7-3d7a-4dd8-ac19-361ec5875206 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163572 May 09 10:11:19.289903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 896/1766] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:19.460297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:19.460872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:19.467424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:19.467881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:19.468656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:19.469142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:19.598961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:19.607398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f4b7ed3-b64d-44a2-bf8e-b052cb611c65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151067 May 09 10:11:19.607968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 871/1767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:19 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:19.840698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:19.841321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:19.847871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:19.848324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:19.849139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:19.849600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:19.991747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:20.000396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:20.001920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:20.003091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b07ef6a-aab2-4409-91b5-e133e852119b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.166341 May 09 10:11:20.003643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 897/1768] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:20.306763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:20.307359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:20.314552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:20.315000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:20.315772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:20.316202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:20.457071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:20.465306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-597f109a-59ef-42c8-9fd9-295b9ff7f184 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162585 May 09 10:11:20.465873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 872/1769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:20.627814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:20.628485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:20.635603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:20.636056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:20.636858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:20.637288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:20.765189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:20.773308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-695a18e3-61c0-4661-9562-044e65051312 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151207 May 09 10:11:20.773876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 898/1770] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:20 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:21.022150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:21.022757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:21.029383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:21.029830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:21.030594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:21.031030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:21.157880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:21.166715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:21.168219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:21.169431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d58bfb4a-f1e5-4860-a681-faf344d384e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.151246 May 09 10:11:21.170000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 873/1771] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:21.483013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:21.483527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:21.490777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:21.491365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:21.492169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:21.492609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:21.624604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:21.633600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af36407f-7eb8-4d54-bf98-4e35e8aeb510 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154687 May 09 10:11:21.634321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 899/1772] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:21.790936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:21.791546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:21.798348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:21.798791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:21.799575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:21.800009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:21.933136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:21.941147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-813f663e-f3e9-460b-966d-25dfbd50f054 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154140 May 09 10:11:21.941720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 874/1773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:21 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:22.187892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:22.188518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:22.195618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:22.196057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:22.196917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:22.197346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:22.337965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:22.347192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:22.349132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:22.350802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f47363c-49fc-4a4a-9b67-4b8ef91eb8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.166616 May 09 10:11:22.351510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 900/1774] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:22.651089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:22.651719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:22.658170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:22.658624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:22.659395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:22.659826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:22.802053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:22.811156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1498cfb9-880c-4ce7-bde4-584ad8ac743a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163755 May 09 10:11:22.811765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 875/1775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:22 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:22.959023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:22.959636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:22.967557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:22.968016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:22.968822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:22.969259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:23.114414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:23.125524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eac9a999-a6fe-4c5c-83c0-c9594987469e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.170675 May 09 10:11:23.126102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 901/1776] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:22 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:23.371009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:23.371521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:23.378048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:23.378490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:23.379238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:23.379667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:23.521303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:23.530160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:23.531666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:23.532931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cce7ece6-0430-4047-97ba-6353247450ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.166026 May 09 10:11:23.533603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 876/1777] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:23.831351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:23.831960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:23.838585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:23.839023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:23.839792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:23.840256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:23.983531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:23.993029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9465196e-1f48-4a7a-a707-a98662d22a33 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166032 May 09 10:11:23.993629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 902/1778] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:23 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:24.195773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:24.196461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:24.203243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:24.203691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:24.204460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:24.204924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:24.345679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:24.354234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ddd697ab-c6e3-469f-b6f9-c031d9f5659c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.162547 May 09 10:11:24.354809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 877/1779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:24 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:24.551726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:24.552252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:24.559362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:24.559806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:24.560592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:24.561037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:24.696964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:24.705568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:24.707082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:24.708262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4cae6be4-9fac-40fc-b78f-665fdc339ea1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160598 May 09 10:11:24.708884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 903/1780] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:25.010823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:25.011339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:25.017951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:25.018408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:25.019215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:25.019696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:25.154359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:25.163217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3911cb95-3c05-471b-8d60-b5a45c0b9398 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156375 May 09 10:11:25.163888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 878/1781] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:25.373070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:25.373671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:25.380298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:25.380779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:25.381556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:25.382129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:25.529450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:25.539313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-87a69dba-c01b-4a93-baa9-163742cb5b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.170752 May 09 10:11:25.539877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 904/1782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:25 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:25.728837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:25.729401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:25.736700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:25.737171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:25.737947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:25.738374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:25.878993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:25.887569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:25.889084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:25.890243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-296c2ac4-d80d-4534-a8db-cce60639de26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.167431 May 09 10:11:25.890836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 879/1783] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:26.180686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:26.181296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:26.188102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:26.188564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:26.189348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:26.189804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:26.329402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:26.338644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed35f854-e294-4d50-9542-2f2bbfb7838f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161914 May 09 10:11:26.339227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 905/1784] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:26.557065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:26.557808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:26.564339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:26.564798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:26.565894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:26.566460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:26.697883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:26.709344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21e99ef6-4332-4594-8290-5c2f7806fee8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156380 May 09 10:11:26.710680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 880/1785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:26 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:26.912932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:26.913538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:26.920221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:26.920698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:26.921485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:26.921922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:27.068218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:27.076900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:27.078399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:27.079566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f9c5a8e8-c861-4460-9cc7-231d7bb406a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.170628 May 09 10:11:27.080132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 906/1786] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:27.356634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:27.357293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:27.364185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:27.364622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:27.365462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:27.365863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:27.502162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:27.510588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ca64dbc-d2a9-434a-9dc4-49dbfc1ea490 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157881 May 09 10:11:27.511160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 881/1787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:27.728433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:27.729002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:27.737722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:27.738247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:27.739411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:27.740024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:27.875773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:27.883805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd296d4b-f23d-4977-a2be-2632ef0b40b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159841 May 09 10:11:27.884351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 907/1788] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:27 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:28.099612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:28.100526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:28.107113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:28.107543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:28.108310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:28.108793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:28.256134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:28.265800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:28.267827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:28.269175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea94336d-e31e-4252-8c75-0151dd548053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.173471 May 09 10:11:28.269736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 882/1789] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:28.528338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:28.528950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:28.535484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:28.535931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:28.536689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:28.537190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:28.669712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:28.678089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7fe795a1-5ca8-487a-a0fe-47e33e564ef9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153864 May 09 10:11:28.678797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 908/1790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:28 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:28.906347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:28.907047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:28.914608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:28.915063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:28.915834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:28.916267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:29.055502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:29.063505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-246f45a5-a8e5-4daf-8373-e0bd15b5a9f0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161204 May 09 10:11:29.064075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 883/1791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:28 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:29.287610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:29.288244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:29.297150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:29.297768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:29.298943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:29.299604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:29.443718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:29.456798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:29.458945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:29.460545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e3af15bc-4c09-4711-ade8-f261f40a56ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.176812 May 09 10:11:29.461200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 909/1792] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:29.695808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:29.696381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:29.702655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:29.703098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:29.703856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:29.704282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:29.838386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:29.846617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ad4f9430-95db-4862-9eb1-9c8e76a64591 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154932 May 09 10:11:29.847193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 884/1793] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:29 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:30.080941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:30.081554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:30.088549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:30.089030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:30.089806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:30.090235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:30.224158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:30.233291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b24e5ed-22df-4d83-8e83-39aae07208b5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156225 May 09 10:11:30.233859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 910/1794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:30 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:30.480394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:30.481062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:30.487974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:30.488424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:30.489208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:30.489655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:30.623256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:30.632515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:30.634037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:30.635202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b214b132-0c2c-446e-b227-ea1874c2d104 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158790 May 09 10:11:30.635770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 885/1795] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:30.863771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:30.864292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:30.871436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:30.871887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:30.872695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:30.873143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:31.003327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:31.011821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6235a4c1-b7f0-4385-9553-cc36aa166798 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151992 May 09 10:11:31.012406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 911/1796] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:30 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:31.254675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:31.255688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:31.265048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:31.265573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:31.266406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:31.266843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:31.403791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:31.411890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73890ea2-8225-40de-b5b5-8547b1978ad0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163900 May 09 10:11:31.412459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 886/1797] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:31 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:31.654467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:31.655060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:31.661868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:31.662322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:31.663093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:31.663530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:31.798160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:31.807660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:31.809173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:31.810378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-97b6af89-6f19-4cbb-aaf5-559110b211e4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160227 May 09 10:11:31.810968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 912/1798] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:32.029927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:32.030489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:32.039108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:32.039556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:32.040354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:32.040813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:32.174351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:32.182700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9453fd3-a0f6-4390-991c-0354c3bbc773 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156744 May 09 10:11:32.183269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 887/1799] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:32 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:32.429454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:32.430142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:32.436612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:32.437082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:32.437847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:32.438275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:32.574431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:32.582489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8bdf0db5-779b-4ec1-91fd-f42ff6f77c93 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157024 May 09 10:11:32.583096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 913/1800] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:32 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:32.829470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:32.830080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:32.836561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:32.837036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:32.837798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:32.838226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:32.984759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:32.993906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:32.995614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:32.997027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b34a3d11-a39d-44a9-8d75-7ad910d6b0a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.171504 May 09 10:11:32.997667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 888/1801] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:33.200261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:33.200977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:33.207787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:33.208240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:33.209034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:33.209484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:33.355893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:33.365007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe390c4a-f454-4a80-9ab2-c9efaad1f4d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168577 May 09 10:11:33.365742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 914/1802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:33 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:33.603138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:33.603754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:33.610494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:33.610953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:33.611710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:33.612136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:33.749932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:33.758402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3fa19f7-fccd-405c-aa11-cb20dcb8a182 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159538 May 09 10:11:33.758976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 889/1803] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:33 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:34.016409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:34.016965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:34.023963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:34.024406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:34.025208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:34.025640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:34.166245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:34.174736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:34.176226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:34.177407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2befa03a-63d1-48ae-aceb-dff63318a091 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165093 May 09 10:11:34.177937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 915/1804] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:34.384653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:34.385290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:34.392064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:34.392509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:34.393888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:34.394590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:34.529242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:34.537938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f108677f-e234-4ad2-bcf2-46ff3ac42997 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157246 May 09 10:11:34.538724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 890/1805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:34 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:34.777628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:34.778225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:34.784633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:34.785107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:34.785866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:34.786267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:34.919938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:34.928405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-69cbc4ce-4081-4128-8f43-0ff94c3f412a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154745 May 09 10:11:34.929391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 916/1806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:35.200299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:35.201439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:35.211674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:35.212164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:35.213018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:35.213456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:35.351599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:35.363097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:35.365404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:35.366897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6cd1869-b982-459d-94a0-53ca23a90f7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.173847 May 09 10:11:35.367451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 891/1807] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:35.555734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:35.556355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:35.563184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:35.563619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:35.564392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:35.564857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:35.695535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:35.704060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4583e8d1-cb45-4a96-94b6-dcab5cfbad45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152212 May 09 10:11:35.704605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 917/1808] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:35 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:35.950795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:35.951675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:35.961362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:35.961806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:35.962575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:35.963008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:36.094577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:36.103290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6b794f6-8072-4b14-aaa6-766c55c9fe25 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159603 May 09 10:11:36.103866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 892/1809] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:35 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:36.385995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:36.386688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:36.393237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:36.393708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:36.394471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:36.394902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:36.527287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:36.536084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:36.537686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:36.538903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54cd79d4-bbc2-41f3-a71b-082db211b8dd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157124 May 09 10:11:36.539458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 918/1810] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:36.721445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:36.722044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:36.729974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:36.730564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:36.731535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:36.732119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:36.881868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:36.890443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5ed9f47-c23f-4cfb-aaed-e3ddb4d63138 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.172837 May 09 10:11:36.891272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 893/1811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:36 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:37.126773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:37.127820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:37.136179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:37.136648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:37.137446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:37.137879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:37.276822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:37.285163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10c152f1-a3af-4b68-993d-51cee0d15fb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.164853 May 09 10:11:37.285740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 919/1812] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:37 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:37.557817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:37.558554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:37.565123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:37.565566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:37.566335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:37.566763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:37.696630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:37.705044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:37.706526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:37.707645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9cddc33-dfb2-45ff-a101-73585a6e0141 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153984 May 09 10:11:37.708231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 894/1813] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:37.907786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:37.908371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:37.914693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:37.915141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:37.915899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:37.916331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:38.045460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:38.053988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b007310-3bbf-42e0-9177-29ec83f55b50 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150240 May 09 10:11:38.054573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 920/1814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:38.305048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:38.305646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:38.312448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:38.312921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:38.313691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:38.314120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:38.447138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:38.455499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f7a930cb-afa5-442e-822c-69bd042fb45b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156266 May 09 10:11:38.456077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 895/1815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:38 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:38.729219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:38.729734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:38.736552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:38.737038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:38.737812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:38.738375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:38.872499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:38.880934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:38.882580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:38.883780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b1392f1-6164-4b3d-be81-9af0a66495e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159789 May 09 10:11:38.884316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 921/1816] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:39.071565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:39.072179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:39.078688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:39.079136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:39.079906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:39.080328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:39.212220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:39.220689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e19b9f8-ed9f-4da8-97a3-9e8972b50e7b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152980 May 09 10:11:39.221283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 896/1817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:39.473353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:39.473946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:39.480893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:39.481335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:39.482097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:39.482521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:39.613231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:39.621630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc91e326-2bba-44a7-ad07-e651e541f00e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152241 May 09 10:11:39.622207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 922/1818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:39.904680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:39.905322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:39.912209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:39.912720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:39.913527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:39.913962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:40.048903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:40.058201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:40.060487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:40.062002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e4d31439-cbf2-47e2-a5c0-495ae1b887b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162944 May 09 10:11:40.062638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 897/1819] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:40.237892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:40.238502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:40.247345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:40.248073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:40.249379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:40.250064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:40.379289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:40.391771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2ff47b2-ed76-4d29-b089-a7ca34c9d475 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153654 May 09 10:11:40.391771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 923/1820] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:40.638886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:40.639616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:40.645785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:40.646206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:40.647428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:40.647576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:40.780355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:40.790851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cc25531-79af-4d4a-8e38-5ca72a12c4cd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155811 May 09 10:11:40.791435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 898/1821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:40 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:41.081915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:41.082552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:41.089168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:41.089617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:41.090398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:41.090836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:41.229349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:41.238457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:41.239955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:41.241299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b42bfe58-8607-4d5a-b036-645f0e1dd1a1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163360 May 09 10:11:41.241858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 924/1822] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:41.404862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:41.405470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:41.412774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:41.413386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:41.414166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:41.414594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:41.549761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:41.558081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6b34df85-20da-48e6-a1d3-41c2985d4d30 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157107 May 09 10:11:41.558662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 899/1823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:41.811751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:41.812613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:41.821681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:41.822128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:41.822901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:41.823326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:41.955990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:41.964243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2eaf84ab-f132-4fbb-9d92-071212f71655 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158309 May 09 10:11:41.964850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 925/1824] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:41 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:42.260242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:42.260896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:42.267349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:42.267813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:42.268603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:42.269067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:42.411476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:42.420458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:42.421994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:42.423159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd0d8de4-cc33-40c5-846e-ae2defca28a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.167013 May 09 10:11:42.423719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 900/1825] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:42.577052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:42.577722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:42.584085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:42.584529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:42.585318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:42.585752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:42.718627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:42.727347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7db3a4ba-f529-47d2-9ba7-595a933bf7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155589 May 09 10:11:42.728447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 926/1826] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:42 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:42.981681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:42.982273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:42.988642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:42.989133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:42.989987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:42.990361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:43.120080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:43.128155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1eb8b235-6c4c-4e9e-a772-ccea913cba77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150530 May 09 10:11:43.128758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 901/1827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:42 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:43.442230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:43.442841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:43.449688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:43.450142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:43.450918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:43.451358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:43.582104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:43.591045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:43.592556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:43.593762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad4e1068-d308-43c8-b538-7c5290d802bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.155561 May 09 10:11:43.594327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 927/1828] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:43.745138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:43.745837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:43.752135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:43.752581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:43.753484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:43.753913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:43.883006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:43.891160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cabc464-be37-46b5-969a-dd7d60283610 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150121 May 09 10:11:43.891732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 902/1829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:43 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:44.146549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:44.147341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:44.153869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:44.154318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:44.155089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:44.155518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:44.287001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:44.294987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-18bccb94-bf13-4107-9ded-798107739471 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152550 May 09 10:11:44.295545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 928/1830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:44 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:44.613100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:44.613709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:44.620517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:44.620989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:44.621747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:44.622177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:44.755295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:44.763796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:44.765322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:44.766476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d15c535e-7713-42f7-b89f-d3771d69be80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157386 May 09 10:11:44.767039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 903/1831] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:44.908720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:44.909342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:44.916180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:44.916686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:44.917641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:44.918102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:45.048882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:45.057047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8262cc4b-51fe-43b0-9815-6eaae40fed5e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152277 May 09 10:11:45.057614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 929/1832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:45.312633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:45.313266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:45.319879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:45.320262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:45.321060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:45.321487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:45.453101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:45.461101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96632373-51ca-4f26-b925-b6711e35c618 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152325 May 09 10:11:45.461673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 904/1833] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:45 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:45.785370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:45.785985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:45.792545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:45.793028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:45.793797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:45.794242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:45.932136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:45.940886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:45.942374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:45.943533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57fc4bd0-f9cd-4b5c-ae3e-ba53a64f1d2b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162146 May 09 10:11:45.944123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 930/1834] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:46.074787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:46.075353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:46.082052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:46.082504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:46.083280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:46.083715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:46.219172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:46.227984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3b61eb4-1035-47af-ba28-68a1acaa8f20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157238 May 09 10:11:46.228580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 905/1835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:46.478095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:46.478613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:46.485141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:46.485578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:46.486340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:46.486765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:46.618119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:46.626427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e3a4326-e751-4917-8530-46712c89d9cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152617 May 09 10:11:46.626994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 931/1836] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:46.962376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:46.962981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:46.969962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:46.970412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:46.971204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:46.971631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:47.109625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:47.118591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:47.120071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:47.121265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0aba8f6c-3faf-4347-8a4a-b91c620496cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162864 May 09 10:11:47.121829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 906/1837] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:47.245755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:47.246370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:47.253036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:47.253484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:47.254255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:47.254688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:47.394781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:47.403966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e214e02c-c3b0-4ab0-8d7d-bf1889f66031 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162132 May 09 10:11:47.404538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 932/1838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:47 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:47.648052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:47.648708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:47.658865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:47.659534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:47.660736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:47.661461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:47.803928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:47.814573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cc016580-3369-43c5-843c-be80ec6093c6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.173350 May 09 10:11:47.815260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 907/1839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:47 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:48.143621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:48.144524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:48.151819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:48.152262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:48.153069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:48.153499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:48.285390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:48.293911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:48.295389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:48.296535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df862086-279b-41ce-ab80-3ce458fb1048 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159521 May 09 10:11:48.297105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 933/1840] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:48.432340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:48.433619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:48.444306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:48.444806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:48.445566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:48.445998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:48.579150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:48.587173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-80f0ab90-011e-4e16-9f30-eddec3a09486 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161187 May 09 10:11:48.587740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 908/1841] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:48 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:48.837040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:48.837638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:48.844257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:48.845838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:48.846661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:48.847128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:48.977508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:48.986083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d656a0d8-7f14-4a53-85bb-7a490cf202c4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155078 May 09 10:11:48.986692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 934/1842] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:48 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:49.314911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:49.315558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:49.322139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:49.322568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:49.323383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:49.323819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:49.472724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:49.486435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:49.488753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:49.490620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44e060a4-5aa1-46d2-b544-c8d0ca7581bd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.179376 May 09 10:11:49.491225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 909/1843] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:49.604789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:49.605398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:49.612123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:49.612567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:49.613359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:49.613780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:49.752405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:49.764388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2a3d9303-cee6-4bff-bcdc-f87b99076ef8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163277 May 09 10:11:49.765132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 935/1844] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:50.008142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:50.008698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:50.016016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:50.016865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:50.017789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:50.018608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:50.159951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:50.168613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c8f3fa9-f010-4d4e-aa31-2e929d562f02 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.167455 May 09 10:11:50.169315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 910/1845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:49 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:50.513573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:50.514579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:50.523940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:50.524398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:50.525213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:50.525651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:50.656774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:50.665936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:50.667418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:50.668577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d11ecd3c-9e17-4043-afb4-f508ef71ebc6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.161617 May 09 10:11:50.669158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 936/1846] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:50.786025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:50.787037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:50.794070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:50.794515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:50.795278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:50.795727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:50.932196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:50.940650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-54687b09-6654-4be4-a6f3-a711d97d41da tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161134 May 09 10:11:50.941255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 911/1847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:50 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:51.186126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:51.186791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:51.193401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:51.193842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:51.194602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:51.195031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:51.326920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:51.335069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-610eb4ca-7b62-480c-8075-92605cabc9df tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152809 May 09 10:11:51.335611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 937/1848] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:51 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:51.691973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:51.692990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:51.703507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:51.704245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:51.705560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:51.706274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:51.844106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:51.856256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:51.858603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:51.860297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b9e0806-e68f-46b7-8821-8f7dfd01b0ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.174835 May 09 10:11:51.861113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 912/1849] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:51.962756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:51.963656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:51.974434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:51.975584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:51.977044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:51.977774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:52.117427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:52.125635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1c9694a-f64c-4a0c-bed7-0e772e3a6dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.170232 May 09 10:11:52.126209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 938/1850] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:52.357004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:52.358031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:52.369540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:52.370293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:52.371687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:52.372460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:52.516968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:52.526108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f38a22e1-5ce4-4ed1-95de-40379b3aaeb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.176202 May 09 10:11:52.526679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 913/1851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:52 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:52.883436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:52.884185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:52.892115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:52.892695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:52.893638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:52.894188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:53.035319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:53.044437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:53.045978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:53.047135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c024d3b0-9e3a-4545-b7ad-7d744b49c5c2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.169630 May 09 10:11:53.047699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 939/1852] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:53.147186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:53.147731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:53.154445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:53.154894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:53.155656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:53.156086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:53.289165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:53.297337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5c340e9e-e02f-4662-8732-3dcaa62c09c2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156814 May 09 10:11:53.297904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 914/1853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:53.544276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:53.545023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:53.551298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:53.551753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:53.552529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:53.553000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:53.700512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:53.715474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-46ce8a19-131f-460a-9d9f-8734dca39180 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.174375 May 09 10:11:53.716576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 940/1854] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:53 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:54.068218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:54.069105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:54.078102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:54.078745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:54.079859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:54.080485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:54.244339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:54.255897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:54.258204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:54.259845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a5d87bf-a7ce-4a3f-b00b-7dc50419c9f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.197231 May 09 10:11:54.260580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 915/1855] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:54.314564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:54.315165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:54.321799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:54.322170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:54.322927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:54.323355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:54.450281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:54.458818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15b3da21-1433-4e19-a0f6-90447811b21c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.148133 May 09 10:11:54.459429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 941/1856] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:54.740819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:54.741436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:54.748247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:54.748720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:54.749478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:54.749935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:54.888697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:54.898846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5b424ad-784d-40d2-a60a-2954845ba395 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.164572 May 09 10:11:54.899429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 916/1857] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:54 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:55.282636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:55.283244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:55.289848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:55.290289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:55.291049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:55.291500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:55.428636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:55.437265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:55.438766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:55.439935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-349cd91c-1ab5-45a7-9aa8-bee4fe069b6f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.161354 May 09 10:11:55.440533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 942/1858] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:55.478979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:55.479589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:55.489609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:55.490255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:55.491028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:55.491460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:55.629114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:55.638009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-518145a3-e508-4f42-9d85-aed09ff9091a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.165545 May 09 10:11:55.638584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 917/1859] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:55 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:55.919544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:55.920494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:55.930702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:55.931461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:55.932790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:55.933495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:56.068260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:56.076627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54855385-232f-4e7e-b29a-9fb8611bb83e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163679 May 09 10:11:56.077231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 943/1860] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:55 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:56.457710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:56.458294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:56.464715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:56.465177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:56.465943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:56.466372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:56.608654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:56.621849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:56.624242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:56.626020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a548c25-cdf4-423b-aa54-0726e1de1127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.172162 May 09 10:11:56.626822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 918/1861] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:56.655460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:56.656065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:56.662987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:56.663429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:56.664191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:56.664618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:56.791642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:56.803089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe087666-65cd-4120-a87c-6ab7b6d0a2ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151314 May 09 10:11:56.803959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 944/1862] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:57.097555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:57.098562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:57.109152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:57.109884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:57.111140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:57.111853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:57.256391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:57.267610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7670cc1d-8883-416e-9c48-714de781bd64 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.176313 May 09 10:11:57.268385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 919/1863] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:57 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:57.649545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:57.650158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:57.656579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:57.657295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:57.657823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:57.658263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:57.799771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:57.808130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:57.809649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:57.810810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37c20641-5129-4a4d-818a-9559b339351c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.166418 May 09 10:11:57.811363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 945/1864] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:57.820571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:57.821288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:57.827477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:57.827931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:57.828694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:57.829187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:57.962546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:57.975535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a5e1847-a8a8-4290-8b19-ed14151889ce tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157984 May 09 10:11:57.976374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 920/1865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:57 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:58.286049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:58.286647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:58.293443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:58.293892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:58.294659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:58.295087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:58.422707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:58.432203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ef9b046-2d8a-49f1-b92c-307940de5fe2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150017 May 09 10:11:58.432729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 946/1866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:58 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:58.829879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:58.830657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:58.837349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:58.837784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:58.838578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:58.839008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:58.989736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:58.998510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:58.999053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:58.999248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:59.000180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:59.001366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0927888d-9ae4-4fcf-bd50-e0e4f3d5ec39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.175365 May 09 10:11:59.001962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 921/1867] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:11:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:11:59.006028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:59.006474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:59.007238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:59.007668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:59.146828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:59.154717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe75b66d-9a8b-4620-9074-c241f2cb22bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.160017 May 09 10:11:59.155296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 947/1868] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:58 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:11:59.453962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:11:59.454878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:11:59.462982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:59.463430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:59.464197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:11:59.464621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:11:59.607045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:11:59.615606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aa00423c-5c57-4c3a-ab32-086c1c75955b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.168266 May 09 10:11:59.616561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 922/1869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:11:59 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:00.020019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:00.020651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:00.027200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:00.027632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:00.028393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:00.028857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:00.163616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:00.171327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:00.172057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:00.172321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:00.173920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:00.175056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ac70a6a-5d37-48be-96eb-87d7f1ed2c7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158995 May 09 10:12:00.175610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 948/1870] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:00.178781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:00.179226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:00.180004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:00.180426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:00.315421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:00.324450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6daf258c-8412-4f24-9ac1-a39aaba4c8dd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156896 May 09 10:12:00.325065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 923/1871] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:00 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:00.637685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:00.638733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:00.648650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:00.649158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:00.649917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:00.650354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:00.780518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:00.788536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20bdbc28-6599-4a0e-adbd-bc21923e55fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157442 May 09 10:12:00.789105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 949/1872] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:00 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:01.197182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:01.197874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:01.206091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:01.206643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:01.207588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:01.208125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:01.343122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:01.343692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:01.351578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:01.352024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:01.352821 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:01.353257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:01.358048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:01.366831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:01.368324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:01.369557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2ae934a-e16e-4590-8d8e-40cffda9c395 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.178222 May 09 10:12:01.370928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 924/1873] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:01.508446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:01.516258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5cf71397-8e7e-44ca-85bc-73b521a9dc24 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.177086 May 09 10:12:01.520697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 950/1874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:01.806170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:01.806780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:01.813373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:01.813821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:01.814564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:01.815008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:01.942636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:01.950598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c82a4755-6fa0-4f68-b18a-84505153efca tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.148401 May 09 10:12:01.951148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 925/1875] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:01 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:02.388290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:02.388902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:02.395659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:02.396153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:02.397160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:02.397565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:02.525379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:02.533595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:02.534162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:02.534293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:02.535680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:02.537349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f43e1d60-4a81-45c6-a271-895d55afa7fa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.152546 May 09 10:12:02.538122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 951/1876] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:02.541494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:02.541943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:02.542714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:02.543141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:02.669744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:02.677806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50812281-abab-457c-8765-c81675992807 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.148092 May 09 10:12:02.678403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 926/1877] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:02.967752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:02.968366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:02.975368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:02.975817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:02.976594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:02.977059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:03.108047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:03.116194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20cf0f34-2440-4f20-b267-4be5a7c850a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152411 May 09 10:12:03.116998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 952/1878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:02 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:03.555946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:03.557302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:03.563961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:03.564419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:03.565233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:03.565671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:03.695081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:03.695824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:03.701819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:03.702736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:03.703179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:03.703949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:03.704375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:03.710563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:03.712074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:03.713270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44537f7f-f3ae-406b-8d05-360b2b3cdb98 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.161498 May 09 10:12:03.713836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 927/1879] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:03.832970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:03.841292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1ec13aad-4b1b-4dd3-a806-5c1e0742995e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150224 May 09 10:12:03.841847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 953/1880] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:04.133641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:04.134281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:04.141018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:04.141483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:04.142553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:04.142940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:04.278064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:04.286626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4582b175-f37a-4d3f-b55a-bfdd92db2c92 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157083 May 09 10:12:04.287254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 928/1881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:04 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:04.732203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:04.732819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:04.739434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:04.739867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:04.740762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:04.741192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:04.860715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:04.861460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:04.868004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:04.868468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:04.869286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:04.869719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:04.878529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:04.888270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:04.889794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:04.891225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a9f82ec9-ff3a-4dfc-b46f-84a8862d6fa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163054 May 09 10:12:04.892179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 954/1882] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:05.004068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:05.012687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e78a4d5-4c3b-4eb9-99e2-61ca853d9b5c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.158303 May 09 10:12:05.013281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 929/1883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:04 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:05.305727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:05.306596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:05.313402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:05.313850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:05.314611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:05.315040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:05.450762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:05.458826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-489d04c2-b566-4e3c-a56a-a4038164cdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158629 May 09 10:12:05.459416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 955/1884] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:05 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:05.909127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:05.909719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:05.917179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:05.917626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:05.918384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:05.918878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.049045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:06.059435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:06.061453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:06.063984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d88ed4d1-81a7-42b6-9e8b-7a0879dd9f6a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158929 May 09 10:12:06.064581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 930/1885] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:06.214943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:06.215629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:06.221877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.222413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.223631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.224227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.260083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:06.260581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:06.267470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.267993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.268824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.269258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.294273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:12:06.356979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:06.365144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3c9707e-b71b-491c-835f-303b5d98df25 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.338636 May 09 10:12:06.365743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 956/1886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:06.375816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2284d11f-fd14-4279-9ecf-c7f07ef0a0e9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 204 len: 0 microversion: 2.1 time: 0.119302 May 09 10:12:06.376428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 931/1887] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:12:06 2022] DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 10:12:06.384560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:06.385289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:06.393191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.394076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.394854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.395312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.530482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:06.540898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f82913b-ac76-44e3-a794-a6177f8db1d6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1720 microversion: 2.1 time: 0.157841 May 09 10:12:06.540898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 957/1888] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:06.582229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:06.582954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:06.589013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.589455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.590213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:06.590640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:06.719049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:06.727835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-007431fa-dcc0-4bec-952d-0e8dcfdd8943 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.255553 May 09 10:12:06.728385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 932/1889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:06 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:07.084829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:07.085462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:07.092579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.093067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.093929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.094401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.229447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:07.237923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:07.239437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:07.240687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02944977-8531-411d-b722-eb66efa3eb4b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160020 May 09 10:12:07.241251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 958/1890] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:07.383064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:07.383695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:07.390170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.390618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.391421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.391847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.525390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:07.533589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3fa678f6-b267-44ca-b1d2-9cfa44cedf9b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154551 May 09 10:12:07.534194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 933/1891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:07 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:07.555593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:07.556195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:07.562754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.563250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.563994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.564423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.698221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:07.706624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba0bb716-3f23-4f66-94d8-7550628de463 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1720 microversion: 2.1 time: 0.155050 May 09 10:12:07.707410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 959/1892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:07.745266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:07.745913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:07.752064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.752552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.753391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:07.753799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:07.962503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:07.970559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e113242b-0296-41b6-8b02-fe2988738fde tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.229255 May 09 10:12:07.971151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 934/1893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:07 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:08.259852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:08.260433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:08.280702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:08.281182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:08.281970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:08.282408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:08.415733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:08.424128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:08.425901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:08.427074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4644870a-c9c6-49b0-831c-228cdb45b1de tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.171454 May 09 10:12:08.427797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 960/1894] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:08.552917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:08.553534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:08.561870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:08.561995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:08.562776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:08.563223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:08.723900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:08.724982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:08.731350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:08.731792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:08.732556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:08.733029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:08.742104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:08.750218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-82247041-8bd0-468b-b018-2317fae012db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.202582 May 09 10:12:08.750704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 935/1895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:08.797171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:08.805159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14aa703e-3ef0-4f68-ad90-22375b85aa92 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1652 microversion: 2.1 time: 0.085186 May 09 10:12:08.805737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 961/1896] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1652 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:08.987996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:08.989020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:08.999577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.000462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.001723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.002487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.003286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-f84f9263-a76c-467b-8599-c2976f265827 req-796d7ba9-5054-41d6-b7b6-4af2c82e4f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3383afcd-c1f1-4a06-b1e3-3bd49e32744a", "name": "network-vif-deleted", "tag": "0533b6e6-0caa-4e2c-8fb3-327f73627c13"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:12:09.012239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f84f9263-a76c-467b-8599-c2976f265827 req-796d7ba9-5054-41d6-b7b6-4af2c82e4f64 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.012714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f84f9263-a76c-467b-8599-c2976f265827 req-796d7ba9-5054-41d6-b7b6-4af2c82e4f64 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.024803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-f84f9263-a76c-467b-8599-c2976f265827 req-796d7ba9-5054-41d6-b7b6-4af2c82e4f64 service nova] Creating event network-vif-deleted:0533b6e6-0caa-4e2c-8fb3-327f73627c13 for instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a on hv-cinder-84108 May 09 10:12:09.030488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-f84f9263-a76c-467b-8599-c2976f265827 req-796d7ba9-5054-41d6-b7b6-4af2c82e4f64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134240 May 09 10:12:09.031752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 936/1897] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:12:09.137584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:09.146266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4cd934ce-a318-4ed5-94ab-1d8e79bd1e89 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.162493 May 09 10:12:09.146877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 962/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:09.445816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:09.446518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:09.452884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.453375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.454126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.454563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.588862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:09.597971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:09.599822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:09.601013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20070623-a345-4635-a4a7-936ea9a739d0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159631 May 09 10:12:09.601575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 937/1899] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:09.767824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:09.768429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:09.777880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.778323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.779104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.779529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.822877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:09.823715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:09.830021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.830431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.831223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:09.831665 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:09.898500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:09.909323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-803b9aa1-41e5-4abf-b169-14e936197631 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090324 May 09 10:12:09.910377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 938/1900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:09.914499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:09.924105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bbb96f28-0717-46ba-8fca-e6096c42ebe5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159052 May 09 10:12:09.924105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 963/1901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:10.163799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:10.164316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:10.170789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.171281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.172056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.172500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.308789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:10.317423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd514f64-2730-4f5c-b7bd-61d049823161 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157665 May 09 10:12:10.318204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 939/1902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:10 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:10.620061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:10.620695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:10.627267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.627715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.628477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.628945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.758930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:10.767734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:10.769274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:10.770444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c177333d-f3bd-4ad7-b5c1-0d0939667eec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154391 May 09 10:12:10.771631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 964/1903] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:10.927027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:10.927614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:10.934434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.934885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.935657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.936066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.941323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:10.941931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:10.948880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.949323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.950094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:10.950522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:10.998840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:11.006980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e314baba-5357-46e6-bd6e-0aabc0b6ef82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083972 May 09 10:12:11.007572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 940/1904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:11.083906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:11.092281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f9eaa247-dca0-48ba-82af-c8b30cfdbe8c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154808 May 09 10:12:11.092887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 965/1905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:10 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:11.334712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:11.335407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:11.341996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:11.342441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:11.343214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:11.343648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:11.476035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:11.484394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-261bce88-13ce-4ce3-a080-ee852b4571e0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153739 May 09 10:12:11.485010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 941/1906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:11 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:11.789467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:11.790073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:11.796687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:11.797149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:11.797917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:11.798349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:11.924696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:11.933840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:11.935372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:11.936543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37fb17e0-f90e-47d4-a37f-aee7b007f234 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.151221 May 09 10:12:11.937173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 966/1907] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:12.023615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:12.024180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:12.031484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.031484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.032268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.032761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.094577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:12.103330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d4bc9325-9288-4d78-bd13-5c16d76e950a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083720 May 09 10:12:12.103916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 942/1908] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:12.112404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:12.113036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:12.119644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.120106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.120884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.121314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.250161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:12.258548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4fa4623a-6b70-415a-b1d4-a1c82c42e94b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151930 May 09 10:12:12.259192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 967/1909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:12.506439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:12.507259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:12.513959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.514402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.515164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.515598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.647848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:12.656196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f0405a45-3382-4eaa-94f8-9ead756dd4b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156830 May 09 10:12:12.656805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 943/1910] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:12 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:12.955731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:12.956379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:12.962939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.963383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:12.964153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:12.964588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.091099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:13.100272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:13.101811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:13.102946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f5217c48-843a-4bf9-8b6d-e02525e3880e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.151350 May 09 10:12:13.103506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 968/1911] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:13.120463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:13.121139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:13.127237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:13.127683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.128437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:13.128902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.190471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:13.198928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-192adef9-6d8f-46e7-84c7-8444ee013528 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082275 May 09 10:12:13.199526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 944/1912] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:13.275637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:13.276162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:13.282969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:13.283418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.284192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:13.284630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.414243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:13.422184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b059a82-1e64-4eb3-9f10-8bb6835728d3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150543 May 09 10:12:13.422755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 969/1913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:13.674004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:13.674650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:13.681385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:13.681836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.682601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:13.683033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:13.818845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:13.827340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-453fdaa7-8a21-4a50-8610-d3e23f14cf35 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157487 May 09 10:12:13.827924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 945/1914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:13 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:14.122132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:14.122717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:14.129226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.129660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.130584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.131016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.216201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:14.216899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:14.223518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.223981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.225070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.225542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.262519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:14.271110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:14.272644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:14.273844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d3abcba-075e-4116-bae5-d3db30890e63 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.155855 May 09 10:12:14.274403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 970/1915] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:14.286573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:14.294726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7ff87547-ce39-496c-9a4d-5dbe3282b3b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083204 May 09 10:12:14.295301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 946/1916] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:14.440033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:14.440959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:14.452479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.453286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.454572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.455311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.593101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:14.601714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e052dbec-26cb-40fb-91ec-a936f400f18a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166027 May 09 10:12:14.602273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 971/1917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:14.844267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:14.844917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:14.852199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.852648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.853457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:14.853892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:14.984947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:14.993310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bd8af6a-16fe-4fbb-b567-0237f649ed41 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153000 May 09 10:12:14.993878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 947/1918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:14 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:15.292769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:15.293371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:15.299962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:15.300410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:15.301198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:15.301626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:15.311283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:15.311885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:15.318092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:15.318539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:15.319305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:15.319735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:15.379949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:15.387914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b0284fc-4140-4e7d-8d62-5fe84940504f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.080434 May 09 10:12:15.388473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 948/1919] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:15.434867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:15.443779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:15.445330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:15.446497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-633571d3-6a86-479d-9474-2d8ec56634af tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157770 May 09 10:12:15.447055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 972/1920] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:15.619240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:15.619846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:15.626221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:15.626664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:15.627422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:15.627847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:15.755838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:15.766219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-81a821ee-9f23-47d7-b6d7-16bf7f9555fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150874 May 09 10:12:15.766795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 949/1921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:16.010875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:16.011402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:16.018213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.018649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.019415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.019844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.149896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:16.158353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ab3f9b9-f601-4af2-a5cc-af124227d671 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151482 May 09 10:12:16.158927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 973/1922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:16 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:16.405161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:16.405796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:16.412622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.413099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.413869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.414302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.465822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:16.466437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:16.473032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.473484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.474672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.475519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.477587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:16.485473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50eef357-a4b0-47b8-a5de-ce53640fc5c9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084362 May 09 10:12:16.486060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 950/1923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:16.610909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:16.619683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:16.621227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:16.622370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85dc1e8a-62f0-4345-a31f-b5d0e5fd46e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160588 May 09 10:12:16.622954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 974/1924] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:16.783875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:16.784501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:16.791323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.791771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.793622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:16.794411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:16.924443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:16.932393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d4b4db9d-6eca-488b-9c91-2b6e53f954f6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152387 May 09 10:12:16.932999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 951/1925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:16 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:17.176018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:17.176526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:17.183512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.183953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.184723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.185181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.311930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:17.320092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-99df8fc7-142a-497c-a94a-204ba2ab3137 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.148191 May 09 10:12:17.320692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 975/1926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:17 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:17.501887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:17.502471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:17.509325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.509780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.510559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.511000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.574982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:17.583185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2d1f1096-5cc4-448c-b82f-696b01a22240 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085341 May 09 10:12:17.583863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 952/1927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:17.641089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:17.641711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:17.647940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.648379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.649175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.649602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.779894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:17.789268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:17.790801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:17.791968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6e08738-1479-440e-9729-24312fea5c9f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154887 May 09 10:12:17.792531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 976/1928] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:17.949877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:17.950479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:17.957182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.957641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:17.958538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:17.959002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.090543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:18.100098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-16e60d0f-4799-421c-9537-fb17f3f96584 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153467 May 09 10:12:18.100903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 953/1929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:17 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:18.338153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:18.338670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:18.345716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:18.346158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.346951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:18.347376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.477610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:18.485801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5bd2a480-b1db-4929-98af-67b98766f7d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152043 May 09 10:12:18.486371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 977/1930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:18 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:18.601087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:18.601663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:18.612089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:18.612543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.613364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:18.613805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.674833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:18.683235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4eca6f46-a6be-435e-b3e2-6e9d45db7b4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086710 May 09 10:12:18.683834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 954/1931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:18.810977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:18.811583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:18.818312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:18.818784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.819618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:18.820080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:18.961097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:18.969943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:18.971483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:18.972672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-afed53f0-c940-4289-a36e-7916605d887c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165611 May 09 10:12:18.973251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 978/1932] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:19.120425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:19.121006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:19.127872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.128326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.129160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.129642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.261103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:19.270211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc5e7012-2cf0-42f3-b8db-27967fc73a0b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153935 May 09 10:12:19.270782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 955/1933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:19.503214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:19.503747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:19.510308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.510762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.511542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.511980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.652235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:19.660309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aec5759e-a6fb-4ac0-814d-394fd4609855 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161370 May 09 10:12:19.660919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 979/1934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:19 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:19.700906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:19.701479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:19.708427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.708920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.709692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.710126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.778644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:19.787250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-302db2f5-d12f-479d-8028-056af48b383a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090451 May 09 10:12:19.787802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 956/1935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:19.991653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:19.992243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:19.998762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:19.999206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:19.999940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.000403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.127845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:20.136844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:20.138380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:20.139578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45d86e44-5ff9-48b6-82b6-17f07d079c7f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.151950 May 09 10:12:20.140149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 980/1936] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:20.287788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:20.288400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:20.295140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.295592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.296375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.296843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.425168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:12:20.425442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb (ip 10.222.0.26) !!! May 09 10:12:20.436105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:20.445331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-61ea1e5a-b169-4b42-9ada-85d671ad150a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161635 May 09 10:12:20.446580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 957/1937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:20.677864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:20.678377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:20.685208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.685650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.686493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.686968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.806264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:20.806873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:20.813721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.814203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.814989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:20.815388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:20.828374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:20.838211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf062db9-2b6d-4d8d-9689-1daa4dfb7e37 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163677 May 09 10:12:20.838211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 981/1938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:20 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:20.881467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:20.889718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c00c88cd-8099-4a58-acad-382bc30ad81f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087716 May 09 10:12:20.890295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 958/1939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:21.160208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:21.161435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:21.168269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.168750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.169522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.169950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.317054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:21.329944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:21.333806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:21.334985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b62c447-8dbd-4d86-ab79-06a0cce39a9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.179675 May 09 10:12:21.335591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 982/1940] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:21.462863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:21.463592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:21.470418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.470863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.471984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.472451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.613627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:21.622189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c8d16517-2a61-4009-9660-d9997ab7196b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163362 May 09 10:12:21.622783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 959/1941] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:21.859222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:21.860005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:21.867486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.867932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.868714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.869156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.906888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:21.907692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:21.915038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.915499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.916382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:21.916872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:21.984383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:21.997466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee024e1a-ddcb-4819-b43b-43bb4caeabf9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094051 May 09 10:12:21.998421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 960/1942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:22.006131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:22.018076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-19dafb4c-7438-4726-a1e1-d5fba5d880b2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.165322 May 09 10:12:22.018677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 983/1943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:21 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:22.361679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:22.362424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:22.370133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:22.370699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:22.371488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:22.371920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:22.513183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:22.522467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:22.523967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:22.525193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a064e703-5ac0-4b2a-93b9-bc3e5d841dcb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.169174 May 09 10:12:22.525723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 961/1944] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:22.640122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:22.640787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:22.647678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:22.648117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:22.648943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:22.649382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:22.786933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:22.795324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3672d07f-5bff-447e-bfce-23ed0888ddcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159422 May 09 10:12:22.795887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 984/1945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:22 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:23.015550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:23.016187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:23.022965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.023431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.024208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.024650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.035608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:23.036397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:23.042894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.043348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.044123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.044557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.086980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:23.095062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3663432b-3fa9-448e-8e48-eb6d17977c65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083486 May 09 10:12:23.095637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 962/1946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:23.173794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:23.182275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed005fcf-cce2-4c90-bdde-6986afa904ed tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150751 May 09 10:12:23.182857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 985/1947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:23 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:23.543728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:23.544433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:23.550818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.551284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.552141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.552610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.693420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:23.701881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:23.703376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:23.704533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f5d3e1a2-ea89-41c1-9570-fc230ce5710d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164926 May 09 10:12:23.705110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 963/1948] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:23.812920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:23.813540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:23.819856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.820307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.821145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:23.821582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:23.955757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:23.964308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b8fc1ba-bd8f-4b36-93e4-c52548df854f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155455 May 09 10:12:23.964928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 986/1949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:23 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:24.112751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:24.113320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:24.120293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.120784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.121562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.122006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.184186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:24.192587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2c8b69cb-4e03-42df-9fbb-155e0c458410 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083781 May 09 10:12:24.193253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 964/1950] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:24.199401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:24.200011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:24.206662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.207138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.207906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.208383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.339891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:24.348347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ae7ee821-d9e0-43d8-b831-52fdcdb8341a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152826 May 09 10:12:24.349443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 987/1951] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:24 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:24.723225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:24.723855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:24.730698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.731144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.731913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.732345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.862025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:24.870658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:24.872158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:24.873351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbea5888-bd7b-40a4-9d95-10bb401c6e5c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154162 May 09 10:12:24.873912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 965/1952] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:24.982096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:24.982680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:24.989190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.989712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:24.990528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:24.990988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:25.052425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:12:25.052715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:12:25.120012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:25.128081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-492e3547-127b-4944-9355-82be6beaf86c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150079 May 09 10:12:25.128657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 988/1953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:24 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:25.210179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:25.210803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:25.217654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:25.218106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:25.218886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:25.219320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:25.281992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:25.290388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c035ce37-6b8a-4ec4-bb7c-f2ba2f458ede tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084128 May 09 10:12:25.290939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 966/1954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:25.366508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:25.367128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:25.373807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:25.374195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:25.374965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:25.375371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:25.508432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:25.516772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a0237d34-88e0-42ce-8185-269a92ae16ab tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154234 May 09 10:12:25.517359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 989/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:25 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:25.891684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:25.892289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:25.898951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:25.899401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:25.900173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:25.900603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.036902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:26.045795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:26.047368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:26.048574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-18a505b7-4f44-487a-abec-49e9d8a4b9e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160886 May 09 10:12:26.049240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 967/1956] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:26.146045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:26.146642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:26.153123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:26.153573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.154341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:26.154766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.287464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:26.295609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd11a105-32da-44fc-baf7-89e3dd62ff15 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153656 May 09 10:12:26.296260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 990/1957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:26.307571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:26.308175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:26.314672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:26.315119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.315884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:26.316318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.379346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:26.388159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-502d2fff-ef6a-4c24-a72a-3ecab049e850 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084405 May 09 10:12:26.388795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 968/1958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:26.534571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:26.535188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:26.542348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:26.542807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.543615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:26.544069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:26.677641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:26.685947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b7164d3-7f4b-407d-a573-e7eee1902714 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155351 May 09 10:12:26.686559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 991/1959] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:26 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:27.068428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:27.069103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:27.075603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.076055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.076885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.077320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.211476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:27.219930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:27.221488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:27.222666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ccc81d58-eba9-4e43-b9ef-66d40f3f95f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158455 May 09 10:12:27.223224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 969/1960] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:27.313777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:27.314421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:27.321511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.321866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.322666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.323094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.405675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:27.406324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:27.413295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.413750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.414545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.415009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.452539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:27.461070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f96794c1-d30a-4903-84df-f46460f93d52 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151184 May 09 10:12:27.461789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 992/1961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:27.477070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:27.485559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26cafaef-9154-4739-b2fc-7dc1eeda577a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083738 May 09 10:12:27.486133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 970/1962] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:27.703937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:27.704457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:27.711370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.711788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.712584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:27.713055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:27.844107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:27.853397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c3ff25c-269a-48ed-abc2-13f75460dbce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153414 May 09 10:12:27.854006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 993/1963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:27 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:28.241929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:28.242540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:28.249286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.249726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.250500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.250929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.385012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:28.394162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:28.395855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:28.397184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8536dcd-ee71-4b65-9826-3222a63616e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159232 May 09 10:12:28.397792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 971/1964] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:28.479182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:28.479795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:28.486161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.486615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.487367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.487793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.502794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:28.504171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:28.511195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.511644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.512421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.512880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.579262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:28.587921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d21017d4-7929-41a7-a980-7bde47fc24eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089053 May 09 10:12:28.588505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 972/1965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:28.626624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:28.634691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8eab26a-395f-4939-ab0b-b9a146332a38 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159484 May 09 10:12:28.635270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 994/1966] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:28 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:28.871079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:28.871743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:28.878962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.879417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:28.880292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:28.880749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.013447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:29.022132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7af8d878-3180-444e-a472-fbdb570788f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154900 May 09 10:12:29.022720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 973/1967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:28 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:29.416291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:29.416933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:29.423979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:29.424460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.425291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:29.425723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.562134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:29.570308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:29.571787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:29.572970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d71fb5de-f10a-4bc2-99f7-ef42f98b4935 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160730 May 09 10:12:29.573531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 995/1968] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:29.605315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:29.605912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:29.612887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:29.613337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.614110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:29.614541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.652366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:29.653036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:29.659502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:29.659953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.660765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:29.661309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:29.677196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:29.685539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-88df3d9a-c7a6-4d03-b62d-a779f898306d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084069 May 09 10:12:29.686122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 974/1969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:30.039653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:30.040246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:30.046646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:30.047077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:30.047901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:30.048342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:30.049538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:30.057591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b2345ee5-52de-424b-8c98-0701187d644d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.409231 May 09 10:12:30.058183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 996/1970] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:29 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:30.177462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:30.185869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e77fa038-811e-4dec-b56c-fca5c159dd8a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150333 May 09 10:12:30.186441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 975/1971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:30 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:30.593078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:30.593776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:30.601277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:30.601725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:30.602515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:30.602955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:30.704529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:30.705754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:30.713537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:30.714165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:30.715064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:30.716334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:30.736275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:30.745282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:30.746824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:30.748042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c61fd9d2-bb10-4738-805a-63e8bb9fe76e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159607 May 09 10:12:30.748628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 997/1972] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:30.802601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:30.811049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fee3fcce-9344-448c-891c-a565ecdec930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.110972 May 09 10:12:30.811707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 976/1973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:31.076049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:31.076514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:31.083940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.084440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.085286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.085719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.203409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:31.204326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:31.211486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.212155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.213179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.213710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.252624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:31.262035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f80fc94d-1f01-46e5-9588-fc17677dec19 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.190009 May 09 10:12:31.262853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 998/1974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:31 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:31.366149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:31.380543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2b87ee5-660a-4dbd-9278-2e571da203ce tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.181277 May 09 10:12:31.381614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 977/1975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:31 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:31.776593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:31.777329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:31.784289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.784860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.785773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.786365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.829268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:31.830157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:31.838904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.839486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.840509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:31.841290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:31.927206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:12:31.927476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:31.927656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:12:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 (ip 10.222.0.26) !!! May 09 10:12:31.947602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3d67d568-ce5e-4c0d-a545-b60e999338ee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.121888 May 09 10:12:31.948682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 978/1976] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:31.958923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:31.967815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:31.969379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:31.970573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9f2da983-437d-43da-a247-becedaa8ae0f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.198155 May 09 10:12:31.971154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 999/1977] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:12:32.282574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:32.283208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:32.290452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:32.290896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:32.291652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:32.292102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:32.404307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:32.405573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:32.415288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:32.416202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:32.417136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:32.417743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:32.446745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:32.455810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a944c8d0-9b10-4889-a669-8dabf32734ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.177236 May 09 10:12:32.456536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 979/1978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:32 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:32.565318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:32.574310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5174d4f4-dd2f-4206-8c32-db44a1f5a819 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.176819 May 09 10:12:32.574908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1000/1979] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:32 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:32.966759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:32.967396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:32.975081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:32.975602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:32.976490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:32.977022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:32.991031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:32.992807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:33.002147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:33.002871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:33.004148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:33.004915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:33.062347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:33.072810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-562f561f-0c12-41e3-88d7-6848a29b943c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.110050 May 09 10:12:33.073590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 980/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:33.174264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:33.188716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:33.191512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:33.193547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3db2f21b-3661-4708-bd17-96628883b089 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.206631 May 09 10:12:33.194437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1001/1981] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:12:33.475227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:33.475873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:33.482343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:33.482782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:33.483538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:33.484000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:33.592508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:33.593548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:33.601265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:33.601856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:33.602726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:33.603432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:33.630135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:33.638881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1bf73781-9c1d-47a1-b362-40163cf2fb20 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168096 May 09 10:12:33.639482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 981/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:33 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:33.752516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:33.760800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef90d057-d7b6-40ce-81c3-6d38a745b6de tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172461 May 09 10:12:33.761433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1002/1983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:33 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:34.098099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:34.098784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:34.106495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.106939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.107719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.108148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.172231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:34.182187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a22fa222-c0ec-4e2f-9ba2-5bd08e58f798 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087780 May 09 10:12:34.182895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 982/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:34.214755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:34.215395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:34.222568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.222855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.223723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.224452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.378081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:34.388012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:34.389593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:34.390874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7fcfdf61-4102-40bb-bf0b-fc714f9e5442 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.180208 May 09 10:12:34.391442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1003/1985] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:34.663198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:34.663888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:34.670962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.671569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.672472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.673048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.782770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:34.784116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:34.795039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.795920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.797243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:34.797978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:34.844110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:34.854894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33461ad6-1857-4e8e-b37c-ade3835c2120 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.195722 May 09 10:12:34.855766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 983/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:34 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:34.960915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:34.969783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f98c436d-5fbd-411e-804e-6d818d2af13b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.194593 May 09 10:12:34.970373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1004/1987] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:35.201643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:35.202241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:35.217865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.218222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.219045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.219478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.290601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:35.299287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48934728-f332-4393-a1aa-2998e209ca87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.101481 May 09 10:12:35.299889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 984/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:35.420222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:35.421046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:35.427993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.428487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.429368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.429851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.573419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:35.582583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:35.584083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:35.585306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a2602c5-7e91-4acd-88d9-65616517d4ea tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.169220 May 09 10:12:35.585876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1005/1989] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:35.874535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:35.875154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:35.881967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.882428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.883229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.883666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.989133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:35.989762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:35.996557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.997076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:35.997844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:35.998283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:36.029717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:36.041428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-812f551b-782b-455b-91a3-ee3d7caf10ad tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.170848 May 09 10:12:36.042118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 985/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:35 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:36.147812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:36.156980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1a909cf-985e-498c-a75d-bbe93047ed9b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172460 May 09 10:12:36.157586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1006/1991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:35 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:36.317222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:36.317857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:36.324223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:36.324720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:36.325790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:36.326250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:36.390594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:36.399725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5645d17f-29ed-402d-8ae6-f7d158f5916a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086436 May 09 10:12:36.400226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 986/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:36.604587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:36.605261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:36.611864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:36.612332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:36.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:36.613549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:36.759258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:36.768592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:36.770330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:36.771710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4c7fed6-c4bf-43eb-ad53-d89d394b422a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.171107 May 09 10:12:36.772387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1007/1993] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:37.059477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:37.060226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:37.066868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.067408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.068187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.068618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.174588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:37.175379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:37.181739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.182186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.182969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.183401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.203585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:37.211707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-477305f6-99a8-4430-b6bd-00605cf7c7a7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156137 May 09 10:12:37.212257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 987/1994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:37.311006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:37.319316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-230b7108-a655-4847-b8ea-bcc1ce49fe95 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.148611 May 09 10:12:37.319899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1008/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:37 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:37.417003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:37.417668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:37.424370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.424867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.425653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.426244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.489479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:37.497718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-85dfc2fe-fdda-4486-bc39-211ca7f2dbd7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084866 May 09 10:12:37.498299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 988/1996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:37.790560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:37.791234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:37.798167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.798584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.799393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:37.799817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:37.949582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:37.961368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:37.962891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:37.964068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ddab5957-8a46-4b5b-adef-94236baebd35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.177557 May 09 10:12:37.964647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1009/1997] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:38.229823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:38.230472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:38.236748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.237208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.237990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.238431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.335950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:38.336745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:38.342876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.343330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.344110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.344557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.368950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:38.377098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5b822998-95bb-4ae5-a34e-ec0a97853fe3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151202 May 09 10:12:38.377683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 989/1998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:38 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:38.477436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:38.485742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7e6495a-65bc-4d44-8bb7-d0c6ce60a224 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153807 May 09 10:12:38.486316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1010/1999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:38 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:38.514460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:38.515041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:38.521761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.522209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.522985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.523416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.592074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:38.601023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2173f66d-6897-43cf-93e7-8f60e78a5a87 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090552 May 09 10:12:38.601618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 990/2000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:38.983504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:38.984163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:38.991077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.991524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:38.992292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:38.992753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.121190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:39.129632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:39.131091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:39.132246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-53f2b21f-9ff6-43e0-b5d0-cac3a65dd5b6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.152776 May 09 10:12:39.132827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1011/2001] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:39.394517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:39.395153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:39.401645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:39.402087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.402895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:39.403324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.503606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:39.504036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:39.511334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:39.511787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.512595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:39.513094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.545417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:39.561784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c559f764-3304-4223-a0e0-2ca9fa6608c7 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.170716 May 09 10:12:39.562971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 991/2002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:39.619184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:39.620135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:39.627072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:39.627618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.628425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:39.628896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:39.661300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:39.669348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f15ff070-4faf-46d0-b7b9-d1d35077920d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.169822 May 09 10:12:39.669927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1012/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:39.691762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:39.699967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3bd8000-2c48-4636-88c2-e0c342df0648 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085253 May 09 10:12:39.700572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 992/2004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:40.151375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:40.152024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:40.158801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.159228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.160010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.160443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.175844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:12:40.176061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:12:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 (ip 10.222.0.26) !!! May 09 10:12:40.300037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:40.309267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:40.310803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:40.311985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7833af2-ec61-4671-8c20-72de977e23f5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164692 May 09 10:12:40.312575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1013/2005] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:40.579583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:40.580159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:40.587160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.587603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.588374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.588851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.686775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:40.687376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:40.693719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.694161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.694927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.695355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.724816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:40.733215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a83419c4-4489-4cc9-bf83-d9f15a61e235 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157464 May 09 10:12:40.734176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 993/2006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:40.746847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:40.747464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:40.753967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.754443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.755206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:40.755636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:40.817432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:40.825562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e1e5e59-570c-44f5-b4dc-a20aa2dd9c79 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090283 May 09 10:12:40.826280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 994/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:40.836094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:40.844580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-645dac23-1bcd-4d84-9ce5-70007ae30eaf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161639 May 09 10:12:40.845203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1014/2008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:40 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:41.330334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:41.330972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:41.337216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.337662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.338441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.338881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.478740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:41.487303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:41.488911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:41.490089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83b980cc-bb85-41af-b980-14bd947df3b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163828 May 09 10:12:41.490708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 995/2009] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:41.751161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:41.751748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:41.758548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.758994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.759763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.760193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.842792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:41.843821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:41.850564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.851009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.851792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.852220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.897928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:41.906039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-935a98f6-8cac-4ab5-ad3f-e7b7458bf3df tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159009 May 09 10:12:41.906623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1015/2010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:41.911755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:41.912857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:41.915932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:41.918557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.919006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.919785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:41.920212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:41.924600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-32bd1480-bbad-4009-82dc-55eb92f0c0c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085733 May 09 10:12:41.925210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 996/2011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:42.052152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:42.061043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-61d0b3fb-3e5a-46f7-b89c-885bfc802105 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153397 May 09 10:12:42.061601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1016/2012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:41 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:42.509362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:42.509878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:42.516497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:42.517017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:42.517796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:42.518231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:42.648607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:42.657478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:42.658991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:42.660169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97a0f1b1-aba0-4bea-9a43-7cace7dfbb70 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154919 May 09 10:12:42.660728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 997/2013] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:42.926235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:42.926894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:42.933696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:42.934142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:42.934937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:42.935345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:42.941672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:42.942342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:42.948629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:42.949106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:42.949875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:42.950309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:43.014356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:43.022854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ebfa0131-1b91-401c-a14b-ed007081cdf3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084908 May 09 10:12:43.023658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 998/2014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:43.075694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:43.078643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:43.079257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:43.084461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-62c6461f-2930-4451-bcd7-dff8212d65b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162195 May 09 10:12:43.085062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1017/2015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:42 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:43.086267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:43.086738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:43.087517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:43.087958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:43.222928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:43.231530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f485710-fc70-4030-91bd-1af8942c5a53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156806 May 09 10:12:43.232107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 999/2016] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:43 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:43.679526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:43.680132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:43.687050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:43.687503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:43.688318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:43.688764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:43.830062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:43.838764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:43.840303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:43.841565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a1cff626-7629-4848-a561-59018e3c6da7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.166284 May 09 10:12:43.842141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1018/2017] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:44.040156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:44.040848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:44.047637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.048096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.048919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.049359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.102642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:44.103445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:44.110384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.110862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.111641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.112077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.112280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:44.120509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-faf8add0-8e48-4919-96c3-d8faf3827d4d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084306 May 09 10:12:44.121135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1000/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:44.242584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:44.249077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:44.249793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:44.251371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4553f533-bf72-489c-81eb-49d9090c6498 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153170 May 09 10:12:44.251959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1019/2019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:44.256097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.256617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.257425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.257853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.389738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:44.398164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0230a2fb-8ec8-44bf-b534-900fb3944307 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153054 May 09 10:12:44.398749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1001/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:44 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:44.861140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:44.861750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:44.868284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.868761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:44.869536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:44.869973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.001988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:45.011449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:45.013136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:45.014341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60027b83-4e64-4f0f-a8de-8fd79b74e5e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157242 May 09 10:12:45.014983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1020/2021] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:45.137981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:45.138550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:45.145466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:45.145914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.146680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:45.147109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.209207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:45.217642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c228c0e0-2d15-4959-95bb-c0b176c3adaf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083618 May 09 10:12:45.218223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1002/2022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:45.268883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:45.269467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:45.276104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:45.276537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.277346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:45.277786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.405642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:45.414361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b19a1cc-1ce0-4dea-9d0e-a58e00cc113e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149395 May 09 10:12:45.414588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:45.414946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1021/2023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:45.415158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:45.421408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:45.421844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.422625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:45.423045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:45.552210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:45.560683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-beb83d13-afc3-4358-a043-ec6402a38145 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150000 May 09 10:12:45.561432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1003/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:45 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:46.034992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:46.035674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:46.043338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.043786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.044579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.045055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.186927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:46.195580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:46.197056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:46.198225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2018e0b3-f362-40d6-92da-7d0fcea26aae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.168022 May 09 10:12:46.198796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1022/2025] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:46.236444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:46.237242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:46.244934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.245395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.246170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.246607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.311623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:46.320423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59b481aa-5547-47ff-a82b-1fa22d6ff026 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088828 May 09 10:12:46.321024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1004/2026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:46.432400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:46.433051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:46.440370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.440855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.441628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.442038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.578702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:46.579319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:46.584179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:46.586369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.586831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.587738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:46.588219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:46.593164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5bf017a-5c4f-4690-825e-813d2d1c3e79 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164958 May 09 10:12:46.593892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1023/2027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:46.731621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:46.742981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6614cd02-21ec-4cce-b0d2-8b825ddb7b8e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.168215 May 09 10:12:46.743575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1005/2028] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:47.219474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:47.220036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:47.226931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.227428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.228300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.228782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.338348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:47.338963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:47.346272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.346728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.347767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.348217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.375358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:47.388257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:47.390700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:47.392406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82a064ec-6ab0-4cca-a43c-c03477fef7db tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.178502 May 09 10:12:47.393311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1024/2029] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:47.424173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:47.433938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22db130d-588e-4685-b520-565e3419df4b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099194 May 09 10:12:47.434691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1006/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:47.611579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:47.612212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:47.620345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.620963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.622089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.622699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.764935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:47.766003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:47.773706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:47.775105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.775746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.776859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:47.777513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:47.782267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d3d21e4d-679f-44a2-9fc4-449d88badd4d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.174453 May 09 10:12:47.782730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1025/2031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:47 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:47.933996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:47.945070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d6e9f8c-b3d5-4883-9006-043efd234cc2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.185922 May 09 10:12:47.946194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1007/2032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:47 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:48.411805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:48.412419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:48.419059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.419508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.420280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.420712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.453949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:48.454536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:48.461141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.461592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.462404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.462811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.530423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:48.538566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8daa6007-fb6f-48cc-91d8-6347e5d73dae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088741 May 09 10:12:48.539150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1008/2033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:48.560559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:48.570081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:48.571833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:48.573096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89caa055-4aec-4105-aa61-6fe051aff314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165522 May 09 10:12:48.573649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1026/2034] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:48.799989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:48.800582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:48.807088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.807540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.808320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.808791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.942799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:48.951325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6f7a8609-e193-4794-b3e8-1fb9e5544c40 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155303 May 09 10:12:48.951886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1009/2035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:48 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:48.966476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:48.967085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:48.973980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.974457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:48.975212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:48.975643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:49.116491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:49.122241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e4407fa-5aa0-4566-9fca-7966b0ee88d9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159560 May 09 10:12:49.122827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1027/2036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:48 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:49.555816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:49.556763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:49.563476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:49.563930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:49.564770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:49.565281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:49.593076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:49.593910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:49.601600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:49.602149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:49.603061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:49.603577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:49.636575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:49.645523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-039e1a74-ac7f-40be-8ffb-8a03f0e7335d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093647 May 09 10:12:49.646133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1010/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:49.749311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:49.757978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:49.759500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:49.760673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bce08951-a25c-4d16-a955-deacabbe3e2f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.171875 May 09 10:12:49.761501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1028/2038] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:49.969093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:49.969714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:49.976749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:49.977205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:49.977994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:49.978427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.117472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:50.126623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f6a867ef-cab5-4c44-8b1a-6bf8e1ef5d83 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161469 May 09 10:12:50.127192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1011/2039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:50.139804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:50.140406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:50.147068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:50.147506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.148267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:50.148708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.279953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:50.288652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9198a09-2571-45db-8f6f-d867b25af5d0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152656 May 09 10:12:50.289255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1029/2040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:50 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:50.663448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:50.664084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:50.671109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:50.671563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.672347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:50.672821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.737113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:50.745640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-67de1a71-0d8f-4b3a-92b8-f7ef93e7d246 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086726 May 09 10:12:50.746222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1012/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:50.779685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:50.780297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:50.787026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:50.787480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.788283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:50.788722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:50.917797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:50.926586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:50.928086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:50.929280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cbdeda27-a85f-47ef-ac82-55626adca844 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153538 May 09 10:12:50.929854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1030/2042] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:51.143833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:51.144336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:51.151049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.151491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.152253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.152694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.288811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:51.296936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cbda84fd-10e9-4d7b-914d-b7637e1be220 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157103 May 09 10:12:51.297503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1013/2043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:51.306081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:51.306838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:51.315605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.316340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.317862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.318604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.458215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:51.466606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff2c3668-fc42-45d7-bc98-0c0b0a7be423 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.164926 May 09 10:12:51.467180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1031/2044] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:51 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:51.763196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:51.763785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:51.770648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.771096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.771858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.772290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.834605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:51.842748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ee3afca-86f9-4b4d-bbcf-eedca830ba01 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083560 May 09 10:12:51.843310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1014/2045] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:51.947989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:51.948608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:51.957039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.957482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:51.958294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:51.958731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.126229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:52.136207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:52.137763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:52.138959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5677dbdc-e55f-49ac-8111-7b1f3095031e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.195057 May 09 10:12:52.139535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1032/2046] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:52.314681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:52.315192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:52.321734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:52.322180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.322944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:52.323369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.451529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:52.460079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1020ba89-804d-41ee-bb0f-598f23edad7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149374 May 09 10:12:52.460687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1015/2047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:52 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:52.483382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:52.483952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:52.490822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:52.491269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.492035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:52.492463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.622754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:52.630991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23073592-5d81-4de8-a272-808d25e422d1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151546 May 09 10:12:52.631564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1033/2048] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:52 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:52.859659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:52.860246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:52.867284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:52.867737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.868521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:52.868994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:52.931221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:52.939246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-49ba82e2-9d9d-4bb5-9b0b-4c838c948489 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083597 May 09 10:12:52.939819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1016/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:53.157424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:53.157932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:53.164390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.164874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.165641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.166067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.299725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:53.308870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:53.310479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:53.311649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e95a2c0a-1916-42fd-a593-736ee3b993cd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158312 May 09 10:12:53.312217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1034/2050] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:53.478259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:53.478782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:53.485375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.485800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.486579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.487018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.625434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:53.633842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b85e9a50-113f-478e-9ea7-508b1bdbefc4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159985 May 09 10:12:53.634459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1017/2051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:53.647907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:53.648482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:53.654983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.655433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.656216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.656656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.788946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:53.798008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff978ebe-bfd4-4b2e-b335-637a750f9fb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154099 May 09 10:12:53.798643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1035/2052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:53 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:53.955811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:53.956421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:53.963434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.963912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:53.964759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:53.965215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.030550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:54.039627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-465c6f22-b1be-4fad-9567-b252f3e67b8b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087784 May 09 10:12:54.040271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1018/2053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:54.330971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:54.331596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:54.339159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:54.339591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.340444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:54.341018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.486429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:54.495640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:54.497287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:54.498448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb040e59-ca29-48fd-9a77-2a47bf9d5ba9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.171596 May 09 10:12:54.499018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1036/2054] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:54.651375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:54.652031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:54.658581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:54.659031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.659806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:54.660253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.795605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:54.805232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95b26417-798a-4b66-8e51-1d8880b7b5d4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157775 May 09 10:12:54.805815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1019/2055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:54.815567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:54.816143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:54.822803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:54.823257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.824017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:54.824446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:54.957471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:54.965770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-87640e74-b687-4324-988d-2470a9eac056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154108 May 09 10:12:54.966343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1037/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:54 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:55.062089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:55.062731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:55.070460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.070972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.071993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.072611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.147640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:55.155758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66abd86c-11ad-4661-a618-ffc99bacde38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.098408 May 09 10:12:55.156386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1020/2057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:55.517689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:55.518309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:55.525295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.525779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.526501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.526938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.660760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:55.669467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:55.670963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:55.672124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0ba6404-916f-40ce-8712-6075a0925d21 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158587 May 09 10:12:55.672697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1038/2058] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:55.823050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:55.823654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:55.830694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.831159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.831920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.832348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.961225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:55.969577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7320a3c1-df16-4746-8663-b69a2bd26fb6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150407 May 09 10:12:55.970096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1021/2059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:55 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:55.983329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:55.983926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:55.990425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.990865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:55.991628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:55.992072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:56.138668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:56.147169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e1e50ca9-5270-4637-bb14-06131ca1b10f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.167718 May 09 10:12:56.147746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1039/2060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:55 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:56.173290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:56.173916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:56.183300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:56.183747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:56.184537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:56.185020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:56.250448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:56.258955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51d23cab-6b31-42be-8658-96c658691a53 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089519 May 09 10:12:56.259525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1022/2061] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:56.691445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:56.691959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:56.698865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:56.699287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:56.700063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:56.700495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:56.832426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:56.841488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:56.842983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:56.844154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3acfdf33-01ae-405a-9bf3-44b219ba6823 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.156945 May 09 10:12:56.844756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1040/2062] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:56.987783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:56.988517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:56.995176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:56.995629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:56.996414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:56.996902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:57.131437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:57.139997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f2681d02-8a14-4480-ba22-1093c5d57173 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156183 May 09 10:12:57.140606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1023/2063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:57.164698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:57.165315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:57.171618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:57.172064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:57.172869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:57.173305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:57.276274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:57.276937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:57.283633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:57.284068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:57.285100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:57.285537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:57.308306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:57.316966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bfc36c35-7bc1-4862-9461-1fbda6b8690f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156065 May 09 10:12:57.317556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1041/2064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:57 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:57.353115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:57.361002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5537c017-fdfe-4348-aec4-c3314e5240f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088646 May 09 10:12:57.361590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1024/2065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:57.863735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:57.864244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:57.871087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:57.871534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:57.872303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:57.872767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.002230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:58.010895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:58.012401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:58.013592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c29bfb6-9d2c-4a31-8ddb-ea3199d5c2ed tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.154138 May 09 10:12:58.014156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1042/2066] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:58.156765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:58.157257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:58.166631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:58.167089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.169028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:58.169472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.308026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:58.316489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c6471955-0fb2-4ae4-b598-ba046c967aac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163642 May 09 10:12:58.317208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1025/2067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:58 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:58.339354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:58.339953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:58.346502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:58.346921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.347905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:58.348358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.378122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:58.378785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:58.385339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:58.385785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.386556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:58.386988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:58.451354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:58.459669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91b2283f-4112-424d-a11b-7d50e3040425 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085396 May 09 10:12:58.460335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1026/2068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:58.478443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:58.486634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57a10ca0-5a17-4374-ab66-74346b73edb6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151108 May 09 10:12:58.487212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1043/2069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:58 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:59.032764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:59.033409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:59.040444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.040929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.041746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.042188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.181391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:59.190795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:59.192337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:59.193558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8b8bcd3-d3f0-4d2a-875c-6d9825b0d3f6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165296 May 09 10:12:59.194128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1027/2070] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:12:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:12:59.335008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:59.335520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:59.342341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.343089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.343545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.343976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.478285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:59.478991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:59.486168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.486910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.487968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.488409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.491065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:59.499605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-465e81b6-0c08-4cdb-97fb-40a104978865 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168679 May 09 10:12:59.500209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1044/2071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:12:59.507246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:12:59.507886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:12:59.515613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.516065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.516932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:12:59.517388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:12:59.562369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:59.570617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-edd98678-eed7-47d7-89dd-24f5f8d2a3ae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096151 May 09 10:12:59.571203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1028/2072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:12:59.654937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:12:59.663078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0068baff-39e6-49f1-bc06-8075d24079b1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161753 May 09 10:12:59.663697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1045/2073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:12:59 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:00.212559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:00.213210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:00.219726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.220185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.221006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.221449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.361303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:00.369797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:00.371303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:00.372500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c392bbe5-7f00-4ad8-ac8a-3af8d1608f6e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163977 May 09 10:13:00.373108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1029/2074] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:00.517931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:00.518492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:00.525274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.525714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.526482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.526910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.589213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:00.590075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:00.596877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.597399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.598211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.598982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.664537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:00.671809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:00.672423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e18442f4-c92a-4605-ac07-57a63483f883 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087325 May 09 10:13:00.673034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1030/2075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:00.680227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:00.680957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:00.681212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-599e00be-783c-47a8-84fc-db62e50e2593 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167141 May 09 10:13:00.682278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1046/2076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:00 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:00.687650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.688104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.688928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:00.689373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:00.823361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:00.832053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7786199-f3de-4570-b225-6c6311eb6f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155288 May 09 10:13:00.832621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1031/2077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:00 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:01.391685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:01.392300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:01.399448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.399896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.400709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.401150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.540503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:01.549556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:01.551212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:01.552385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0accf48e-bb0e-4d02-8b04-f90f37574ac8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164737 May 09 10:13:01.553138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1047/2078] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:01.690134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:01.690906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:01.698038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.698517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.699506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.700120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.702236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:01.703137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:01.712354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.713504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.714798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.715701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.777146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:01.785956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5768ffe1-825f-4c94-a71c-a845ff2edc94 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099704 May 09 10:13:01.800126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1032/2079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:01.850444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:01.851439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:01.858229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.858794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.859647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:01.860153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:01.869352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:01.880327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-15bf6b32-243c-4679-a377-db3af161b042 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.184509 May 09 10:13:01.882730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1048/2080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:02.002719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:02.011425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f61d97c-2c01-49c1-89b4-829ba4c72992 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.165352 May 09 10:13:02.012015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1033/2081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:01 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:02.571969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:02.572595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:02.579794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:02.580348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:02.581246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:02.581752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:02.724928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:02.734154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:02.735778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:02.736987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fd511540-8ede-4627-bc9b-627051f76353 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.169088 May 09 10:13:02.737566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1049/2082] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:02.809718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:02.810331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:02.817683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:02.818166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:02.818949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:02.819391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:02.885676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:02.894855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2c3d128f-e1b4-4b9e-b436-0d8a08ab872d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089020 May 09 10:13:02.895449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1034/2083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:02.910651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:02.911759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:02.922627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:02.923341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:02.924776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:02.925689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.034475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:03.035764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:03.046609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:03.047408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.048799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:03.049581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.084321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:03.092713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17dca06f-19b6-40ef-937f-121e1bd3f84b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.189752 May 09 10:13:03.093299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1050/2084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:03.210886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:03.219026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09ff9241-75a0-4b75-ba1e-513e3d514a78 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.192265 May 09 10:13:03.219632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1035/2085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:03 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:03.756156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:03.756782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:03.763459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:03.763913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.764707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:03.765151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.911943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:03.912564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:03.917242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:03.918953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:03.919391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.920185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:03.920621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:03.927026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:03.928577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:03.929976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51054051-46f8-4295-aaf0-93b63bbe69e7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.177788 May 09 10:13:03.930512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1051/2086] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:03.984546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:03.993123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99345c20-28fb-4503-abc7-93270cd9f608 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085266 May 09 10:13:03.993708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1036/2087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:04.110678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:04.111350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:04.118024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:04.118504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:04.119389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:04.119827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:04.245118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:04.245744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:04.250374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:04.252543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:04.253031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:04.253887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:04.254303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:04.259633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa3d1e9d-17e8-40e1-9c4b-c413a57e6bf5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152760 May 09 10:13:04.260377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1052/2088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:04 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:04.394064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:04.402327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e0880e08-4eb5-4188-b5c3-997be82a5d6f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161030 May 09 10:13:04.402906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1037/2089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:04 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:04.951440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:04.952113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:04.959001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:04.959447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:04.960209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:04.960640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.010876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:05.011615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:05.018456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:05.018904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.019679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:05.020131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.084125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:05.098401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-219c63e7-606b-4d29-a191-333b88df67af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091206 May 09 10:13:05.099683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1038/2090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:05.113822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:05.122299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:05.123829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:05.125065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c8508693-00f7-450c-b0e9-63bce053fd25 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.177672 May 09 10:13:05.125669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1053/2091] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:05.277426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:05.277942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:05.284343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:05.285011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.285791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:05.286223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.414129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:05.419848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:05.420460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:05.422697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2aa20e5c-a00f-4262-a051-f18d58bb4aa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.149190 May 09 10:13:05.423310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1039/2092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:05 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:05.426713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:05.427165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.427948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:05.428380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:05.560020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:05.568818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-291c2a15-f11d-4862-92de-1e8ed22d9ce1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152807 May 09 10:13:05.569403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1054/2093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:05 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:06.121502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:06.122165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:06.128973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.129430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.130209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.130650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.144180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:06.144884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:06.151348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.151798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.152566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.153080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.196481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:06.207228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b79ed6b9-6dc2-4603-8837-db0329e65042 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089561 May 09 10:13:06.207824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1040/2094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:06.312467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:06.321904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:06.323418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:06.324619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-12e4e9e6-60e5-4904-8309-98b3c8c08e50 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.184601 May 09 10:13:06.325217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1055/2095] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:06.441887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:06.442405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:06.449008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.449385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.450155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.450580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.586611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:06.587369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:06.591962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:06.595255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.595679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.596494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:06.597014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:06.601729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ae83444-50f5-40bf-8652-cd913a808dbb tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163740 May 09 10:13:06.602805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1041/2096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:06.735846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:06.743988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cd366252-1de3-4b2d-89ab-2263ccc7d218 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161385 May 09 10:13:06.744559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1056/2097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:06 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:07.225080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:07.225775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:07.232609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.233114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.234008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.234486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.302777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:07.311201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b66d7275-5430-4c8f-93cb-cc5c8b2c948c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090445 May 09 10:13:07.311759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1042/2098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:07.343846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:07.344588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:07.352963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.353405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.354186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.354614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.492297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:07.501231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:07.502729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:07.503889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a8e0655-031a-4fbd-bcfc-c4771728d5a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164190 May 09 10:13:07.504447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1057/2099] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:07.619662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:07.620273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:07.626557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.627038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.627812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.628284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.761512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:07.761705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:07.762123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:07.768241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.768710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.769566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:07.769904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9d53485-a469-4418-8b94-2b921ab60e1d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154167 May 09 10:13:07.770029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:07.770489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1043/2100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:07 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:07.900808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:07.909020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a36d8bff-ae60-4e42-8b36-d462388283b8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.151365 May 09 10:13:07.909687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1058/2101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:07 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:08.328281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:08.329007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:08.336487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.336972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.337924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.338185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.402319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:08.410659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09cd4a32-425f-4f44-b83c-776c88fb50e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086570 May 09 10:13:08.411229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1044/2102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:08.523749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:08.524362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:08.530936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.531369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.532131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.532555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.666928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:08.675882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:08.677543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:08.678685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-73e92445-68c4-4c4c-af79-9c50a7710266 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158922 May 09 10:13:08.679248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1059/2103] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:08.787735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:08.788367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:08.794840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.795334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.796229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.796717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.922560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:08.926420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:08.927091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:08.930940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a90bf45-e80a-4e23-adc5-e0467639648e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.147190 May 09 10:13:08.931564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1045/2104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:08.933102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.933546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:08.934315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:08.934745 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:09.064966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:09.073272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-76e7a8e3-b0f3-4d9b-933c-f73698f7072c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150755 May 09 10:13:09.073865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1060/2105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:09.427884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:09.428487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:09.435364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:09.435822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:09.436591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:09.437072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:09.499010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:09.507382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ba5e124-7944-4489-bbe3-223e06d63098 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083513 May 09 10:13:09.509848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1046/2106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:09.698496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:09.699092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:09.705861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:09.706382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:09.707223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:09.707659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:09.843887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:09.853305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:09.854861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:09.856120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b26e87d-c994-48a4-af63-93275d193b20 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.161735 May 09 10:13:09.856695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1061/2107] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:09.948450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:09.949152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:09.955557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:09.956056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:09.956913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:09.957355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:10.088973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:10.090604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:10.091220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:10.097596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-124a7707-0f68-4fd5-bf2e-ffae97b5b930 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153018 May 09 10:13:10.097782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:10.098227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:10.098696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1047/2108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:10.099444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:10.099879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:10.404782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:10.413129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-652d5646-5178-4f65-9961-3272bc2674a5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.326420 May 09 10:13:10.413694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1062/2109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:10 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:10.525191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:10.525771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:10.532607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:10.533080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:10.533852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:10.534305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:10.596866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:10.605181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51e2941e-4a3e-40ad-8713-6a294727ee82 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083887 May 09 10:13:10.605751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1048/2110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:10.875295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:10.875888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:10.882982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:10.883424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:10.884184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:10.884611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.018725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:11.027047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:11.028539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:11.029802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8c4d61f5-bbc1-44d4-a794-c8a4370b7e1f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158522 May 09 10:13:11.030354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1063/2111] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:11.115273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:11.115884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:11.122440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:11.122889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.123656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:11.124093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.259006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:11.267025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9acc104-a530-4315-9bdf-1ce9e8a6760c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155670 May 09 10:13:11.267601 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1049/2112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:11 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:11.430890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:11.431502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:11.438092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:11.438544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.439326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:11.439764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.570826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:11.579212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9664acb7-0390-42a2-8597-f1d5638bccbd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152232 May 09 10:13:11.579770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1064/2113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:11 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:11.622238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:11.622793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:11.629757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:11.630201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.630965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:11.631396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:11.701918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:11.711552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc72a99e-5112-4250-9878-1c18d00e74e5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093210 May 09 10:13:11.712123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1050/2114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:12.048957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:12.049780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:12.059163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.059701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.060502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.060951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.195926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:12.204482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:12.206066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:12.207324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78688f7b-cdaf-4393-bcf7-d76da45224f4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162606 May 09 10:13:12.207878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1065/2115] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:12.284168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:12.284914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:12.291659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.292111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.292928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.293365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.594384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:12.596710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:12.597375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:12.604008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.604318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-03e3dc1b-6efe-4885-b27c-9eaa23750d5a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.323810 May 09 10:13:12.604525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.605064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1051/2116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:12.605360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.605803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.734653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:12.735545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:12.740387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:12.743052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.743645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.744896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:12.745476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:12.752500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17bc2da1-227a-4261-80a1-d9d38bb00c98 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159600 May 09 10:13:12.753150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1066/2117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:12 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:12.816892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:12.825571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d72ebffd-f390-4821-9b69-655456c253ec tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095940 May 09 10:13:12.826146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1052/2118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:13.226735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:13.227392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:13.234529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.234978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.235765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.236475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.373431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:13.382657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:13.384159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:13.385346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-25c13003-a082-47d8-8a57-1647b1041429 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163046 May 09 10:13:13.385895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1067/2119] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:13.621672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:13.622600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:13.629991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.630441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.631221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.631650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.767975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:13.769360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:13.770006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:13.776168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.776396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84db5a9f-5c71-4692-aad2-0e06f9f7b1e3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.158444 May 09 10:13:13.776628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.776910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1053/2120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:13.777526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.778065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.849820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:13.850438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:13.856780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.857208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.857995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:13.858431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:13.915323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:13.920529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:13.923812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-396c27c9-fa69-40ab-8088-6cb42839de68 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158352 May 09 10:13:13.924418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1068/2121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:13 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:13.928717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6f5c51af-e43b-43fc-a796-0f5dcc782e34 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083273 May 09 10:13:13.929289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1054/2122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:14.404415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:14.405128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:14.412026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.412498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.413311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.413747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.551322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:14.560806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:14.562452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:14.563717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77ad9f24-99a2-4cfa-a10d-9da21800badd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163339 May 09 10:13:14.564295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1069/2123] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:14.794485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:14.795226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:14.802214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.802664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.803438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.803872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.938716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:14.941624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:14.942239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:14.947353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6b3aeaa6-1859-45fb-9407-1289f03a0689 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157089 May 09 10:13:14.947944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1055/2124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:14.948246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.948741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.949573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.950002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.953368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:14.955442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:14.961813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.962251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:14.963022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:14.963455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:15.025678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:15.034258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-413b32b6-024d-4a25-8967-9ceb148220d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085259 May 09 10:13:15.034840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1056/2125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:15.084204 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:15.092957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85111f67-af83-4bcd-a3cf-03f7e0d5f712 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155151 May 09 10:13:15.093570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1070/2126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:14 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:15.582401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:15.583013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:15.589510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:15.589967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:15.590736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:15.591175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:15.726958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:15.735952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:15.737475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:15.738662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-13d5e606-62bc-4bf7-8c97-05fbc0e3e747 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160329 May 09 10:13:15.739216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1057/2127] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:15.965094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:15.965681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:15.972296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:15.972782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:15.973875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:15.974314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.051932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:16.052604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:16.059559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:16.060017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.060831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:16.061270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.105214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:16.113855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0af0348d-a52b-4bdf-adcb-c84096c36424 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152815 May 09 10:13:16.114764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1071/2128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:16.119053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:16.119642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:16.125548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:16.125761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:16.126187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.126949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:16.127380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.133893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-87976a65-995b-43b1-a14c-f9eed7eca853 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086442 May 09 10:13:16.134488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1058/2129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:16.257547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:16.266019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bfe5a3ed-4e06-43a9-9df4-b8acbb9d7116 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150454 May 09 10:13:16.266625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1072/2130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:16 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:16.757752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:16.758386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:16.765242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:16.765718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.766542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:16.766979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:16.906520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:16.916044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:16.917717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:16.918934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ff812a0-1810-4fd6-8a82-95c8912c6559 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165270 May 09 10:13:16.919478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1059/2131] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:17.132078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:17.132692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:17.139273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.139723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.140500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.140974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.151462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:17.152074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:17.159004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.159814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.160602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.161075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.223939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:17.232336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58be00c0-4a65-4544-a0a9-0eca98cac2d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084785 May 09 10:13:17.233164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1060/2132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:17.276050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:17.283619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:17.284316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:17.285069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-46bb6f9b-4971-4737-b75a-484611cc4913 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157485 May 09 10:13:17.285654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1073/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:17 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:17.290402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.290859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.291631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.292072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.424681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:17.433132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-57572edf-c9fa-4ec8-9b5d-2f854afcd85d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153349 May 09 10:13:17.433817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1061/2134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:17 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:17.938001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:17.938613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:17.945354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.945810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:17.946591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:17.947022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.082636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:18.092163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:18.093689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:18.094863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f184354-a569-4dce-b848-88162e9726c6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.160871 May 09 10:13:18.095416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1074/2135] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:18.249893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:18.250513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:18.257343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:18.257802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.258575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:18.259012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.302519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:18.303132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:18.309896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:18.310348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.311158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:18.311600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.332464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:18.340543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a171782-66d2-4724-a914-3968ede27de0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094648 May 09 10:13:18.341238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1062/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:18.446208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:18.452488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:18.453158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:18.455441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5b5e805f-3545-43b0-bf92-0a6de44ff1b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156764 May 09 10:13:18.456195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1075/2137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:18 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:18.459315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:18.459760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.460538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:18.461028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:18.594286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:18.602988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-43c065a6-616c-430d-ac4b-6f4d88a23b9a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155828 May 09 10:13:18.603562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1063/2138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:18 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:19.113843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:19.114447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:19.121246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.121698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.122476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.122908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.253176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:19.259357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:13:19.259596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:13:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 (ip 10.222.0.26) !!! May 09 10:13:19.264627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:19.267667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:19.269024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e6985cd5-8bd5-443e-bf88-30ec5c1d31df tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.159216 May 09 10:13:19.269593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1076/2139] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:19.358752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:19.359383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:19.368612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.369095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.369910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.370340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.433011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:19.441468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bea9bc9a-4824-4a00-834b-707f37869f88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086632 May 09 10:13:19.442059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1064/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:19.472786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:19.473676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:19.480434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.480907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.481679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.482109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.617536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:19.620440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:19.621084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:19.626294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e65617f-a72f-440a-9528-e6f63fb2df3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157423 May 09 10:13:19.627942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.627942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.628615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:19.629006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:19.631630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1077/2141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:19.763043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:19.772107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93291f33-6e36-48e3-bbde-7c72bc60d66d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155473 May 09 10:13:19.772644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1065/2142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:19 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:20.288266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:20.288912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:20.295472 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.295931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.296697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.297172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.425751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:20.434304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:20.435791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:20.437046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed4fa683-aca5-47e6-9504-5a86b980c748 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.152852 May 09 10:13:20.437608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1078/2143] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:20.458650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:20.459243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:20.465784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.466223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.467013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.467443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.533163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:20.542018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bee06a36-cdf9-4f4a-9095-507eb19e1938 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087235 May 09 10:13:20.542551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1066/2144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:20.644030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:20.644682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:20.651750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.652191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.653007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.653438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.784048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:20.789752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:20.790366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:20.795447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9a3c742f-ac44-4ed4-b9d8-5ca2fae24513 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155069 May 09 10:13:20.796464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1079/2145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:20.797075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.797603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.798459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:20.798906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:20.934232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:20.943465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07b5e37f-127d-4fa4-b5e7-5caa437c9e42 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157670 May 09 10:13:20.944072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1067/2146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:20 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:21.456256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:21.456940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:21.463323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.463782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.464547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.465027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.561659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:21.562069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:21.570474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.570926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.571728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.572166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.621886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:21.634014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:21.634422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:21.635635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:21.635779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7257c4e-2c15-4fc4-9b16-65a55f2c230d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.183496 May 09 10:13:21.636244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1080/2147] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:21.644568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35568a09-e503-48b7-ba3b-19994e625f67 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087414 May 09 10:13:21.645187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1068/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:21.813798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:21.814465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:21.821248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.821697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.822465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.822897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.960881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:21.961530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:21.962602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:21.968259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.968719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.969527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:21.969966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:21.971925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16d5d8f6-4643-43f9-8b80-5787e3be53a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161964 May 09 10:13:21.972773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1081/2149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:22.110723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:22.119455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2fc7d9a-b114-4d13-a2a4-ac487bb7d7c9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.162423 May 09 10:13:22.120015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1069/2150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:21 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:22.660424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:22.661384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:22.661973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:22.662132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:22.669166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:22.669619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:22.670410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:22.670847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:22.671733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:22.672488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:22.673839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:22.674609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:22.738628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:22.751847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1f7a16e-0528-4b34-974d-9797e33adb06 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094100 May 09 10:13:22.752940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1070/2151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:22.858361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:22.867503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:22.869026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:22.870236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-046439a6-d833-4513-9787-891b963f27ff tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.217425 May 09 10:13:22.870795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1082/2152] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:22.990260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:22.990873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:22.997641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:22.998071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:22.998862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:22.999292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:23.138736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:23.139728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:23.140202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:23.149366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:23.150071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:23.151332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:23.152029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:23.152778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-165c2d5d-b033-46bc-9ff6-14f60f51b788 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166364 May 09 10:13:23.153697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1071/2153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:22 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:23.299662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:23.313000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-779c9f51-7f8a-4267-8683-87498a0efe9f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.179086 May 09 10:13:23.317005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1083/2154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:23 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:23.774063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:23.774757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:23.781569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:23.782023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:23.782801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:23.783236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:23.855401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:23.864133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-28fd5135-263a-428f-9102-18a1757da3d9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094103 May 09 10:13:23.864721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1072/2155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:23.889602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:23.890222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:23.896718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:23.897178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:23.897955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:23.898389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.035657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:24.045004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:24.046750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:24.047976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-586f4664-eda8-4e84-978c-bf71f00c6aa0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162629 May 09 10:13:24.048609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1084/2156] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:24.178037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:24.178563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:24.186294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:24.187093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.188463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:24.189327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.332020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:24.332737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:24.339553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:24.340094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.341015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:24.341454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.360234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:24.370026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97d67e42-4bf6-4be3-bdee-759dfef2d978 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.196187 May 09 10:13:24.371030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1073/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:24 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:24.482785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:24.491167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f6400b61-39f0-4ca7-884e-e7c84d4c4fbe tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163226 May 09 10:13:24.491753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1085/2158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:24 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:24.881971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:24.883565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:24.892880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:24.893633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.894942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:24.895686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:24.964704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:24.974359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f4b1801-8301-4f97-a3b4-451e17e65ac2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096203 May 09 10:13:24.974941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1074/2159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:25.068072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:25.068746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:25.075798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:25.076250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:25.077083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:25.077553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:25.228513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:25.238369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:25.239881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:25.241112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02da72a8-de88-4244-ad12-cab8f40a0f83 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.177371 May 09 10:13:25.241686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1086/2160] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:25.396582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:25.397234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:25.403793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:25.404247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:25.405085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:25.405523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:25.509965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:25.510676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:25.518857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:25.519308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:25.520119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:25.520560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:25.566292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:25.578170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a8c31df-e446-4a36-9e23-7cb470b8e0bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.185540 May 09 10:13:25.579086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1075/2161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:25.682896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:25.691558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-011a1a2f-0111-4f73-84b7-acc06230448a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.186165 May 09 10:13:25.692142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1087/2162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:25 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:25.999971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:26.000721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:26.008378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.008996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.009977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.010732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.090864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:26.100994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ac0ce87-fd47-40f0-82e2-3684c5ffa3c8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.105000 May 09 10:13:26.101581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1076/2163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:26.259922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:26.260565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:26.267517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.267969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.268874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.269314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.428702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:26.437606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:26.439099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:26.440398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a1c3d790-a25e-4177-a8db-89e42ddfe750 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.184589 May 09 10:13:26.441026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1088/2164] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:26.595999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:26.596811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:26.603247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.603693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.604468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.604928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.709917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:26.710587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:26.718431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.718955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.719751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:26.720193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:26.741292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:26.749449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e7bfd3e-44c0-4049-bc09-a7dcc56f1e3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.157375 May 09 10:13:26.750121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1077/2165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:26.857459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:26.872016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-49051a87-daaa-457c-8a68-5804bf8a9f28 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.166452 May 09 10:13:26.873112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1089/2166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:26 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:27.119077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:27.119725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:27.126932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.127385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.128270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.128759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.194134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:27.203013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d63d0256-dd77-48f3-8198-414b7105bd3b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088045 May 09 10:13:27.204136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1078/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:27.459852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:27.460418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:27.466963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.467412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.468189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.468629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.600969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:27.610160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:27.612146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:27.613039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-24cf4e57-20a8-4eb1-a746-b17c0214fd65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157339 May 09 10:13:27.613631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1090/2168] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:27.766823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:27.767340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:27.773821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.774267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.775034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.775460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.889727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:27.890542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:27.899872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.900326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.901328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:27.901770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:27.910319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:27.918553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a5a12f69-9625-4143-b6fd-fe8c76720882 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155784 May 09 10:13:27.919133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1079/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:28.035347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:28.043731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fbb353e0-5c90-4db7-8329-5bba61a22056 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157917 May 09 10:13:28.044506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1091/2170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:27 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:28.220743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:28.221354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:28.228349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:28.228838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:28.229602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:28.230032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:28.292536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:28.300793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b9c2e8c-2b46-4667-9662-ca9d4faa789c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084036 May 09 10:13:28.301404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1080/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:28.635302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:28.635936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:28.642286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:28.642741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:28.643599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:28.644039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:28.777629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:28.786498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:28.788013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:28.789231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fccfe8f5-ef21-495e-a27f-e10a02f513ad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.157936 May 09 10:13:28.789805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1092/2172] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:28.935932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:28.936461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:28.943449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:28.943934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:28.944772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:28.945217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.061335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:29.061939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:29.068628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:29.069139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.069894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:29.070354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.078921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:29.087455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-85e9d799-0ddf-412b-8f19-a14cf88f0350 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155649 May 09 10:13:29.088033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1081/2173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:28 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:29.203272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:29.211843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-184007f5-4daa-44e4-aac8-f566bf4fa702 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.154471 May 09 10:13:29.212457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1093/2174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:29 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:29.318195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:29.318819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:29.325675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:29.326128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.326918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:29.327359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.390565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:29.399448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-18e275dd-ae72-4f35-a5af-ea4685d2ded0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085253 May 09 10:13:29.400033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1082/2175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:29.807622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:29.808270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:29.814580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:29.815064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.815833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:29.816260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:29.970691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:29.980802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:29.982400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:29.983654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce8e1642-fcfd-4e40-b5af-5788a2218616 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.180052 May 09 10:13:29.984264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1094/2176] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:30.105756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:30.106287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:30.112853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:30.113389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:30.114227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:30.114760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:30.229767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:30.230497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:30.239671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:30.240208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:30.241137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:30.241635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:30.262047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:30.270129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d659e81-4a9d-4016-8602-e0708efcf33d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168494 May 09 10:13:30.270768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1083/2177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:30 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:30.378434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:30.387292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f7ef06c-5413-4b02-8010-af589c40f028 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161760 May 09 10:13:30.387869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1095/2178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:30 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:30.417039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:30.417650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:30.424464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:30.424943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:30.425720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:30.426155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:30.488076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:30.496570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2bedd20-c9db-4ab0-b90b-51ce5fe980ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083570 May 09 10:13:30.497180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1084/2179] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:31.003910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:31.004545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:31.011112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.011556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.012313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.012781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.141573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:31.150565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:31.152052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:31.153230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2d465ad4-3bc9-48c5-aeca-e80d5c4228fb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.153374 May 09 10:13:31.153785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1096/2180] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:31.287123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:31.287739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:31.294238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.294693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.295453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.295858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.405144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:31.405738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:31.412533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.413032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.413810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.414240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.427186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:31.436148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-334c887c-7a07-4a8a-8022-c645099c2bef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153046 May 09 10:13:31.436773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1085/2181] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:31 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:31.513582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:31.514832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:31.520802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.521233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.522005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:31.522542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:31.548291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:31.560078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-967c7424-d2a3-4962-b1e2-5014c3cbedfc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158530 May 09 10:13:31.560806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1097/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:31 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:31.588737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:31.596785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35d0b568-d821-4fb3-818f-2dcea9b90804 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087065 May 09 10:13:31.597354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1086/2183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:32.175751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:32.176357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:32.183302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.183777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.184633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.185148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.316329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:32.325753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:32.327267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:32.328450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-98c4f4f5-bf76-4c68-b955-0028fb497fb5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.158714 May 09 10:13:32.329085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1098/2184] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:32.454636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:32.455201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:32.462606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.463048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.463814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.464243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.577643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:32.578392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:32.585695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.586175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.587246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.587960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.602148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:32.613617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dd848a73-50e6-43ca-8acd-b4fd84362f29 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163528 May 09 10:13:32.614212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1087/2185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:32 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:32.618963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:32.619568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:32.625845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.626308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.627092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:32.627641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:32.692452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:32.701244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-48efab1e-1835-44cc-958b-a4294b9be894 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085906 May 09 10:13:32.701807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1088/2186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:32.726836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:32.735663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f0c3c010-3857-4cc3-b740-524e1a571425 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.162098 May 09 10:13:32.736306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1099/2187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:32 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:33.346704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:33.347304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:33.354175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.354623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.355394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.355821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.492198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:33.503570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:33.505084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:33.506280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d4161cbe-7c6e-4e66-bcf8-693737f93eac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.163553 May 09 10:13:33.506892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1089/2188] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:33.632321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:33.633233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:33.640784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.641215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.641998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.642431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.720215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:33.720918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:33.727844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.728298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.729353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.731963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.787144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:33.796544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:33.797297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74b5e339-ff7b-4dfa-a0b7-2ccd732fb58b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.169813 May 09 10:13:33.797897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1100/2189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:33 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:33.803272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:33.804047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:33.810591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.811118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.811316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6af79cd2-66ae-4bb2-9555-01b2139b7f62 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095429 May 09 10:13:33.811819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:33.812253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:33.813195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1090/2190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:33.957353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:33.965949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e754a746-0511-4cbb-8c37-a1c147a47a5a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.166846 May 09 10:13:33.966531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1101/2191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:33 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:34.526627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:34.527433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:34.534936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:34.535513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:34.536398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:34.536967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:34.682345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:34.691813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:34.693430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:34.695043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4dfdf795-387d-4b2e-b06a-79c2a8d81a39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.172303 May 09 10:13:34.695761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1091/2192] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:34.822775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:34.823685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:34.830451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:34.830897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:34.831666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:34.832093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:34.833712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:34.834801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:34.844922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:34.845655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:34.846958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:34.847696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:34.944253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:34.953828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7766c774-3df9-40bc-9eaf-224879679dbb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.127231 May 09 10:13:34.954595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1092/2193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:34.984101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:34.993285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:34.993621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b947a952-93f9-44e4-9e54-ac4c78b1ccc1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.174587 May 09 10:13:34.994136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1102/2194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:34 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:34.994327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:35.004645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:35.005484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:35.006899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:35.007709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:35.139684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:35.149431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1a7c78f-aa5a-4bc0-bf71-cfe93c57ad77 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161024 May 09 10:13:35.150068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1093/2195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:35.714817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:35.715430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:35.722221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:35.722798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:35.723926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:35.724404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:35.869072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:35.878394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:35.880218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:35.881508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-65e1af3a-07dd-4a15-97d5-df5b9ce53a87 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.170754 May 09 10:13:35.882147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1103/2196] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:35.977585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:35.978197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:35.985399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:35.985845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:35.986626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:35.987095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:36.021826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:36.023041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:36.030575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:36.031098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:36.031954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:36.032570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:36.062376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:36.074383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bab00e8e-91f2-4b40-8f9b-809430e1a632 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.101198 May 09 10:13:36.075135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1094/2197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:36.168030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:36.168839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:36.176441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:36.177011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:36.178983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:36.179764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:36.181833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:36.192421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95bc9aa6-241b-4ddf-984e-85bc444f0425 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.177335 May 09 10:13:36.193310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1104/2198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:36 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:36.326851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:36.335373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1711c53-4d0a-474a-9413-986c72b3cc52 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.171822 May 09 10:13:36.335965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1095/2199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:36 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:36.902321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:36.902914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:36.909643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:36.910062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:36.910849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:36.911282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.052980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:37.061771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:37.063232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:37.064422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe748283-f1af-4394-adb7-20f3e9c313be tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.166475 May 09 10:13:37.065033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1105/2200] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:37.091637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:37.092280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:37.099238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:37.099692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.100466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:37.100929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.163456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:37.174473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0fa4b1ed-73f3-441c-844e-b7d2b9d50624 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086400 May 09 10:13:37.175521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1096/2201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:37.211320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:37.211931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:37.218580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:37.219035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.219824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:37.220265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.352788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:37.353552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:37.360079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:37.360641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.361637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:37.362075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:37.369738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:37.378135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-82cf8591-3806-4387-a0b6-a7a35eeb67c6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.171038 May 09 10:13:37.378753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1106/2202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:37.497877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:37.506805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ee648fa-3e64-4fde-b176-f7261196c2f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157918 May 09 10:13:37.507385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1097/2203] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:37 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:38.083734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:38.084473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:38.091791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.092424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.093279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.093717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.202333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:38.203342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:38.212629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.213257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.214157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.214800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.269776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:38.280898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:38.283029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:38.284715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-85efe5b9-e764-4246-95ab-b73f1df09b84 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.205048 May 09 10:13:38.285813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1107/2204] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:38.299551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:38.309103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ad387c76-2571-44d6-bf91-7bf45a32c3a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.112952 May 09 10:13:38.309748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1098/2205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:38.396542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:38.397270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:38.404097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.404536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.405356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.405791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.525633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:38.526438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:38.533758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.534469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.535364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:38.536071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:38.556474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:38.568429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5b31f04-cdf2-4dea-a232-d8e5432fb8a6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.176379 May 09 10:13:38.569062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1108/2206] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:38 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:38.685191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:38.694090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6c57cf9-6433-480d-8781-f499ab8067d5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172864 May 09 10:13:38.694830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1099/2207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:38 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:39.307937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:39.308597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:39.315669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.316155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.317176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.317647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.332033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:39.333118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:39.343842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.344608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.345991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.346789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.416045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:39.424690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6e032004-f687-453b-8883-6488226e8572 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099834 May 09 10:13:39.425292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1100/2208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:39.486651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:39.496306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:39.497863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:39.499073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1034d1e4-5b9c-4132-b8e2-68e2b4c871e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.195395 May 09 10:13:39.499624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1109/2209] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:39.586239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:39.586840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:39.593365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.593811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.594637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.595086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.716079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:39.717199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:39.727423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.728173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.729580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:39.730362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:39.753781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:39.763709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fa80a401-bf58-4dcc-8775-a06f859b7d97 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.181342 May 09 10:13:39.764489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1101/2210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:39.883324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:39.891813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f377a7c3-5957-45a1-aae3-f4571c61002c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.182841 May 09 10:13:39.892464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1110/2211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:40.446668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:40.447326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:40.454216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.454667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.455502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.455946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.518769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:40.519859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:40.525588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:40.527176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.527627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.528403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.528888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.536180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d047df1-8d9f-4909-9f74-c66439beac46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093366 May 09 10:13:40.537055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1102/2212] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:40.679430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:40.688717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:40.690327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:40.691493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43c2b0d3-ce5e-427f-be39-7fda942e3030 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.177188 May 09 10:13:40.692045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1111/2213] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:13:40.787916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:40.788686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:40.795653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.796114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.796952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.797393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.909703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:40.910317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:40.916778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.917237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.918013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:40.918452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:40.938015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:40.952137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e79e38f-bd90-4c0e-9d89-ae1765fabc7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168026 May 09 10:13:40.953167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1103/2214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:41.074155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:41.082857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c07b4016-c348-46a4-b061-3e106947142f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.177148 May 09 10:13:41.083468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1112/2215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:40 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:41.554991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:41.556182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:41.564945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:41.565638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:41.566819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:41.567567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:41.657278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:41.667958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-320a550a-f49c-436c-a3ee-a96810296197 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.118225 May 09 10:13:41.668732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1104/2216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:41.712347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:41.713187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:41.721446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:41.721999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:41.723217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:41.723747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:41.891267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:41.901219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:41.902816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:41.903996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e58eef3-1c5e-433f-85ad-aee4e5abcd26 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.196291 May 09 10:13:41.904563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1113/2217] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:41.979221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:41.979839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:41.986486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:41.986944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:41.987732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:41.988178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:42.101592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:42.102195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:42.108435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:42.108918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:42.109687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:42.110117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:42.129062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:42.137923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6c0561e-8c96-4412-ba6b-388d1a028e45 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162562 May 09 10:13:42.138518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1105/2218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:42.259777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:42.269180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-abd5f74d-ca63-40b9-b228-bc76853ec370 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172112 May 09 10:13:42.269812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1114/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:42 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:42.692897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:42.693473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:42.702386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:42.702837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:42.703611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:42.704044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:42.766158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:42.774746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2b703c7-e50d-47e1-8ac1-8619025a9b4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086485 May 09 10:13:42.775314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1106/2220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:42.923500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:42.924164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:42.931964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:42.932386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:42.933284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:42.933692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.120645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:43.130098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:43.131636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:43.132876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79f927f6-7c89-44c6-93a9-7e8d445ab6e2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.213648 May 09 10:13:43.133452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1115/2221] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:43.157777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:43.158429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:43.165399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:43.165860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.166636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:43.167100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.287525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:43.288324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:43.295981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:43.296442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.297278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:43.297718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.310246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:43.319259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d232241-72ea-48c9-9fe5-21ef343047d6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.165371 May 09 10:13:43.319841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1107/2222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:43 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:43.444317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:43.453328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-10f2ef9a-ce2d-4be0-aba1-7592bd587d87 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.170521 May 09 10:13:43.453903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1116/2223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:43 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:43.796878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:43.797987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:43.809858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:43.810610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.812070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:43.812731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:43.905478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:43.914785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d410e4bd-d609-45a6-abf7-170e594c8985 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.125553 May 09 10:13:43.915369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1108/2224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:44.153216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:44.153867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:44.160545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.161056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.161809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.162332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.307436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:44.316927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:44.318608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:44.319848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1169593a-cc3e-4a37-aebe-be96818e2ab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.171340 May 09 10:13:44.320495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1117/2225] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:44.338253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:44.339003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:44.345856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.346315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.347079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.347525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.475800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:44.477715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:44.488566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.488566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.489248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.489619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.494262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:44.503322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8b6368b6-f3dc-41c3-ae05-e9a0ce7ee3e1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.169474 May 09 10:13:44.503902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1109/2226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:44.631415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:44.640282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17067c28-b18a-45ba-a1ca-ff8e821bf3d7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172203 May 09 10:13:44.640887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1118/2227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:44 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:44.932399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:44.933177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:44.940438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.940944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:44.941752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:44.942197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.010301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:45.019136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b21f8ee2-2f85-43a9-a06d-1d8d5ed6add8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090621 May 09 10:13:45.019733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1110/2228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:45.340469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:45.341177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:45.348597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:45.349077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.349851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:45.350283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.486783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:45.495686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:45.497233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:45.498396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de045ced-a900-44e5-a557-6076df1d9b51 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.162050 May 09 10:13:45.498996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1119/2229] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:45.521011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:45.521659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:45.528162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:45.528618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.529430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:45.529862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.657892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:45.658379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:45.660619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:45.665564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:45.666078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.666865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:45.667280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:45.669246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7119477c-970b-4165-88b0-24c726837e55 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152201 May 09 10:13:45.669812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1111/2230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:45.802536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:45.810832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e212119-14ff-42e5-80ec-09d31e61e44e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.156979 May 09 10:13:45.811478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1120/2231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:45 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:46.036703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:46.037371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:46.044703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.045150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.045935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.046376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.112047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:46.125990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-964cd6ba-ec39-4bcb-9f39-90e45615559c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092996 May 09 10:13:46.127024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1112/2232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:46.517487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:46.518121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:46.524997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.525431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.526250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.526691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.666635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:46.675729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:46.677266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:46.678454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02ce9614-cda2-465d-a0ac-33592b0b2f72 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165179 May 09 10:13:46.679028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1121/2233] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:46.693122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:46.694209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:46.704443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.705294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.706651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.707416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.828340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:46.829091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:46.837008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.837667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.838711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:46.839249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:46.899188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:46.911389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-351d5fe9-e5b7-407b-8617-c0a89ee38efd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.225464 May 09 10:13:46.917203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1113/2234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:47.017041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:47.026560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e50a741-110d-4142-864f-4b735d42114e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.202392 May 09 10:13:47.027259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1122/2235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:47.152213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:47.152931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:47.160204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:47.160692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:47.161600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:47.162046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:47.233501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:47.242073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-712e8d0a-8da3-4c4f-b6ef-8adf7dc60e3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094039 May 09 10:13:47.242674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1114/2236] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:47.697255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:47.698162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:47.705242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:47.705724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:47.706531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:47.706974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:47.877573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:47.888446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:47.890089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:47.891296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89e19899-dda2-40b9-b296-f4fa597de38f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.198118 May 09 10:13:47.891839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1123/2237] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:47.936995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:47.937589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:47.945048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:47.945695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:47.946541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:47.947021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:48.055570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:48.056191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:48.063693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:48.064175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:48.065070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:48.065521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:48.150413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:48.164067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90dd608b-4038-41d7-b71b-2d79d791745e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.230794 May 09 10:13:48.165318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1115/2238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:47 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:48.250608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:48.259514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:48.260132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:48.263999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d250868e-d2e7-41b3-8f1e-63dcc3f36cc7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.212183 May 09 10:13:48.265174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1124/2239] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:48 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:48.267010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:48.267486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:48.268282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:48.268970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:48.355002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:48.367354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b0cec60-36e5-4e2e-a0e5-cb5293bc1ef7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.111800 May 09 10:13:48.368049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1116/2240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:48.920070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:48.920809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:48.927681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:48.928352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:48.929289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:48.929828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.077357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:49.087218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:49.088852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:49.090041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-63f76eb8-2111-48be-95fb-4374c5b00e09 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.174022 May 09 10:13:49.090605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1125/2241] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:49.189017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:49.189730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:49.196721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:49.197177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.197988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:49.198416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.293992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:49.294820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:49.302449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:49.303067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.304121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:49.304612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.353484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:49.364241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22e40164-6500-4021-a528-4fb3de6ad83d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.179142 May 09 10:13:49.365068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1117/2242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:49.390982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:49.391749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:49.399306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:49.400011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.401089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:49.401640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:49.474166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:49.481141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:49.486469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f604293d-f691-43e9-a70e-29230e585a86 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.198525 May 09 10:13:49.487344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1126/2243] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:49 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:49.492611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ae36334a-c6b9-458d-9d89-07acf18d7ccc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.106227 May 09 10:13:49.493443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1118/2244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:50.109989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:50.110695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:50.119475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.120030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.121063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.121504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.266739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:50.275997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:50.277604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:50.278922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a6ade45-52de-4a62-8c92-d99dc52166d9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.173075 May 09 10:13:50.279523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1127/2245] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:50.389766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:50.390424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:50.397498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.397949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.398724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.399156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.507406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:50.508108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:50.517361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.518169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.519571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.520302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.562650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:50.573406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b1f4b8b9-ab43-4faa-9d1e-eaf104afe87d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.187472 May 09 10:13:50.574220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1119/2246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:50 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:50.579768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:50.580654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:50.590498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.591093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.591992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:50.592523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:50.684057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:50.694834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7482c533-9b19-47cc-b280-c6d0ba4ea1a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.119043 May 09 10:13:50.696081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1120/2247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:50.715160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:50.729938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-14538a88-8ccc-48b9-8044-9355ef6d47c3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.227278 May 09 10:13:50.730995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1128/2248] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:50 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:51.299557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:51.300171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:51.306625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.307074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.307846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.308279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.461191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:51.473044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:51.474889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:51.476184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5941a992-2a2f-4078-9fb5-1b707d184b80 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.181400 May 09 10:13:51.476868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1121/2249] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:51.598880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:51.599590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:51.606781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.607282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.608141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.608555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.714860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:51.715730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:51.723839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.724299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.725154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.725593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.755437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:51.770343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff6e1c1b-7b50-4402-94f7-2f025bcc2765 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.175454 May 09 10:13:51.771540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1129/2250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:51.779995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:51.781282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:51.798830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.799613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.801345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:51.803599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:51.805720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:51.809890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cd47608b-9a6b-4ad9-9aff-7ace7a185ea1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099458 May 09 10:13:51.810580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1122/2251] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:51.962517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:51.971275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8eb3474-0af1-49cc-97a1-a957c0a0affa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.198193 May 09 10:13:51.971876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1130/2252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:51 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:52.497560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:52.498212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:52.505784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.506237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.507040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.507475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.659384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:52.668847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:52.670381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:52.671590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-643b6fbd-7eb4-489e-8e2c-e2b8df695895 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.178969 May 09 10:13:52.672160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1123/2253] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:52.788397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:52.789154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:52.796153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.796619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.797440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.797884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.829384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:52.830407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:52.838186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.838637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.839438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.839853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.913662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:52.927524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-49a755f6-a789-4ea2-9ea9-07998056498a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.103350 May 09 10:13:52.928571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1124/2254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:52.957505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:52.965969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e47bd39-df05-4abf-8dbb-602454a90be6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.181456 May 09 10:13:52.966571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1131/2255] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:52 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:52.988917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:52.989532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:52.995865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.996599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:52.997413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:52.997845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:53.408532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:53.418065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d882f4ab-37a7-40df-a05c-f1775aa7295e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.433154 May 09 10:13:53.418670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1125/2256] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:52 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:53.697197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:53.697746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:53.704955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:53.705446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:53.706297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:53.706813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:53.850049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:53.859628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:53.861233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:53.862451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-615f7e83-fcc4-4f9d-b6e5-8671f9be690b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.169635 May 09 10:13:53.863018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1132/2257] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:53.946169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:53.946906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:53.953916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:53.954289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:53.955068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:53.955491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:53.987486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:53.988612 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:53.997901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:53.998526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:53.999491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:54.000117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:54.035587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:54.049673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e981d6f4-14cc-455d-8105-b6d4ae11bd14 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.107482 May 09 10:13:54.050697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1126/2258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:54.428824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:54.435497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:54.436111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:54.438441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44c74420-4c96-4399-8b94-89f50933df9f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.457492 May 09 10:13:54.439164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1133/2259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:54.442562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:54.442994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:54.443790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:54.444222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:54.583941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:54.592229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eaa1499d-4ee5-4604-9976-9fbfdea7a4c7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160597 May 09 10:13:54.592829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1127/2260] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:54 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:54.882163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:54.882985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:54.890140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:54.890644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:54.891499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:54.892013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.029350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:55.039295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:55.041053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:55.042427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-015d1dfd-4a05-43fd-a84a-0ac157f8047a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.164353 May 09 10:13:55.043022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1134/2261] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:55.067721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:55.068402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:55.075688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:55.076216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.077106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:55.077582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.146871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:55.155962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-31ad3a3a-5923-4f7e-8df1-e934b57693a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092157 May 09 10:13:55.156557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1128/2262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:55.465504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:55.466093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:55.473453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:55.474060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.474944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:55.475475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.613844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:55.614970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:55.625860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:55.626729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.628077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:55.628887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:55.634213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:55.646740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4f552f55-7e0b-40a6-a03a-4e1ee3378419 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.184994 May 09 10:13:55.647939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1135/2263] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:55 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:55.776975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:55.786218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ea5b355-f041-45ed-aa29-f40209fd8455 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.179617 May 09 10:13:55.786870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1129/2264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:55 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:56.066208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:56.067329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:56.078949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.079844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.081261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.082025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.174136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:56.174758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:56.181922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.182372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.183160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.183709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.260799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:56.264843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:56.270046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:56.271715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:56.272999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c6fb4b4d-8bec-4c63-9c1f-0f67ab9c22e9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.214378 May 09 10:13:56.273590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1136/2265] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:56.273800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-be014a0a-1089-4b8c-bc49-31254e06af3e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.103958 May 09 10:13:56.274313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1130/2266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:56.671769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:56.672281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:56.679110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.679554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.680317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.680789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.804501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:56.805116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:56.812007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.812626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.813541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:56.814152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:56.822271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:56.831769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-98c5d4bc-93cb-47fd-b52d-b86694f0513e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163417 May 09 10:13:56.832587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1137/2267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:56.958065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:56.967084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-46b39dcb-1e5c-418c-a0c3-b9563f7a9485 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.166652 May 09 10:13:56.967677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1131/2268] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:56 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:57.292487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:57.293249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:57.301184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.301577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:57.302330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.302534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:57.302703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.302870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.310877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.311326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.312082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.312518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.386092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:57.400470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-985d9828-6035-494a-a994-e4a68f8b768e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.103184 May 09 10:13:57.401550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1132/2269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:57.460659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:57.470161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:57.471779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:57.473366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8d17266-1835-406a-9535-786a32dbc21f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.185100 May 09 10:13:57.473953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1138/2270] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:13:57.852535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:57.853196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:57.860498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.861073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.861899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.862437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.986603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:57.987495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:57.997457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:57.998348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:57.999768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:58.000705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:58.017958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:58.030248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-748409a4-c16b-43fe-8e23-4cd0a58bdf0f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.182246 May 09 10:13:58.031410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1133/2271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:57 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:58.160026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:58.168209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4bd941b1-3d27-4f04-a3b6-342c7a4cf9a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.186104 May 09 10:13:58.168844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1139/2272] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:57 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:58.418984 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:58.419631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:58.429015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:58.429807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:58.431174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:58.431943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:58.493822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:58.494742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:58.502253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:58.502999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:58.503859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:58.504484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:58.513772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:58.523936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92c42693-089e-4535-959d-aa55badc8d80 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.109373 May 09 10:13:58.525028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1134/2273] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:58.658507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:58.673826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:58.676683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:58.678811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e5d20a7d-6511-4f9b-9556-c71ab9779b0d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.188852 May 09 10:13:58.679808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1140/2274] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:13:59.055752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:59.056352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:59.063060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.063509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.064492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.065037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.186244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:59.187109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:59.193987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.194560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.195499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.196253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.204136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:59.212854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1bd8116a-3970-4173-9909-644828d253ec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.160988 May 09 10:13:59.213446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1135/2275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:59.345183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:59.354140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f7ac41f-8a9c-4b2c-a396-a8e535cb48fd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172106 May 09 10:13:59.354767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1141/2276] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:59 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:13:59.543472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:59.544479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:59.552559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.553116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.553961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.554434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.625712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:59.640357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c308995-beee-42d9-bc8f-a1517aff90e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.100839 May 09 10:13:59.641437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1136/2277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:13:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:13:59.697938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:13:59.698679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:13:59.705984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.706433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.707227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:13:59.707663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:13:59.851078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:59.861142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:59.862855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:13:59.864455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0ea27b67-4376-49c5-a495-d007cb7ff00c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.170489 May 09 10:13:59.865183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1142/2278] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:13:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:00.240012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:00.240631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:00.247421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.247844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.248649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.249140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.375166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:00.376277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:00.383816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.384396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.385353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.385895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.401089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:00.410532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-610852b9-5de2-4427-b62f-a74c0558a14d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.174543 May 09 10:14:00.411330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1137/2279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:00 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:00.533088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:00.547023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c0c5f222-c82c-4317-b2a2-ef47af0eb778 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.179047 May 09 10:14:00.548027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1143/2280] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:00 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:00.666125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:00.666818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:00.674279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.674762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.675521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.675989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.742362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:00.751199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7d4cebd1-4fca-4483-9a60-b880415eaa72 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089059 May 09 10:14:00.751794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1138/2281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:00.884727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:00.885491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:00.892879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.893319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:00.894150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:00.894561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.068164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:01.077732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:01.079571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:01.080877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-da55b312-7013-4f6c-a6bf-f01877b1087a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.200441 May 09 10:14:01.081501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1144/2282] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:01.429501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:01.430164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:01.436982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:01.437549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.438381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:01.438950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.576219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:01.577047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:01.588395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:01.589256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.590632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:01.591160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.606899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:01.617299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f0115298-2393-41b3-9e94-b244fadfc553 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.191761 May 09 10:14:01.618201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1139/2283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:01.742970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:01.757262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f03c12ac-45b7-4c97-af93-8376f1f3c141 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.188423 May 09 10:14:01.758156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1145/2284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:01 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:01.775489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:01.776382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:01.783573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:01.784026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.784862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:01.785298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:01.856016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:01.865531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-835088e4-ea1d-44b0-91ce-e44eec81679a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094200 May 09 10:14:01.866110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1140/2285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:02.104400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:02.106252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:02.116225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.116754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.117591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.118142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.272653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:02.281848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:02.283573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:02.284869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7994fba0-26bd-422e-9942-cf23cf4cecf4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.187059 May 09 10:14:02.285456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1146/2286] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:02.637092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:02.637603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:02.644532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.644996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.645799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.646237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.776162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:02.777203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:02.784632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.785116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.785985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.786433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.793552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:02.802885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4094f4b3-c817-42db-9bd7-b2e93d4317bd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.169896 May 09 10:14:02.803485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1141/2287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:02.886402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:02.887464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:02.895922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.896695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.897997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:02.898772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:02.952738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:02.963188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e168b2fb-f0dc-41cc-8946-9cc236f6c229 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.191434 May 09 10:14:02.963961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1147/2288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:02 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:02.975192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:02.985668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e8ca37f-2031-4404-9612-c30e2b924893 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.105865 May 09 10:14:02.986389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1142/2289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:03.305324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:03.306103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:03.313443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:03.313917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:03.314703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:03.315138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:03.454719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:03.464057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:03.465600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:03.466811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20982851-e483-4cba-b9f5-1051db6f116b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.165534 May 09 10:14:03.467397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1148/2290] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:03.829594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:03.830513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:03.838316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:03.839140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:03.840020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:03.840600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:03.986812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:03.987435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:03.994476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:03.994936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:03.995716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:03.998017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:04.047731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:04.056580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-83f0b593-9710-4634-9465-b7890c008f7d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.232918 May 09 10:14:04.057768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1143/2291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:04.063406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:04.064434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:04.073013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:04.073600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:04.074761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:04.075445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:04.153234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:04.157399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:04.167184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8288858d-20af-46d8-8251-5d7960f72511 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.184349 May 09 10:14:04.167780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1149/2292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:03 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:04.168609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9efb45d8-87ee-4940-a00d-454dc4d3b379 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.109290 May 09 10:14:04.169685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1144/2293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:04.486511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:04.487419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:04.494903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:04.495426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:04.496320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:04.496854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:04.653988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:04.663615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:04.665213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:04.666458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-52fcd676-7f4c-454b-bb60-7c3ed9c2bec1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.184151 May 09 10:14:04.667043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1150/2294] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:05.080124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:05.080889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:05.087971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.088434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.089257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.089700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.189742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:05.191239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:05.201954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.202850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.204368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.205033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.263429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:05.279569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dfb33bbc-ae78-4c67-8b30-2f5642356cba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.203505 May 09 10:14:05.280537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1145/2295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:05 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:05.289170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:05.290371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:05.301197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.302066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.303541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.304323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.407018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:05.417253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5e5fccea-82f1-4247-980e-a641fcfee0fd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.134767 May 09 10:14:05.418113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1146/2296] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:05.421552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:05.436055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5953c69-816f-409d-8be3-3bfb7b469081 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.253654 May 09 10:14:05.436720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1151/2297] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:05 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:05.798612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:05.799276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:05.805925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.806380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.807154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:05.807588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:05.946301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:05.955633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:05.957112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:05.958316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7a821a9-1469-4d88-b7dd-b028f6dea462 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.267253 May 09 10:14:05.959114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1147/2298] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:06.301729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:06.302730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:06.310072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.310577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.311402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.311876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.446279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:06.447396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:06.458971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.459774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.461215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.461460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:06.461937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.470513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a05f0168-0341-4462-a5e9-ea97ffac579d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.173136 May 09 10:14:06.471432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1152/2299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:06.476172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:06.476826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:06.484008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.484451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.485396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.485853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.559164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:06.572327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f8e6396-5721-4219-a559-510a57406ef1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.133486 May 09 10:14:06.573240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1148/2300] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:06.641081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:06.650056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7dfb62fa-ac1d-4030-8462-daf87e572da1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.177824 May 09 10:14:06.650677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1153/2301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:06 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:06.982047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:06.983367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:06.993294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.994070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:06.995444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:06.996165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.168235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:07.177903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:07.179591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:07.180905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4cbef3c4-f2ae-43aa-93b0-4437fc85f15a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.206134 May 09 10:14:07.181516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1149/2302] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:07.493099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:07.495032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:07.502455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:07.502908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.503695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:07.504132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.593380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:07.596202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:07.604850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:07.605271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.606673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:07.607257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.684991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:07.695866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:07.696397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-edd0eba1-bb4e-4fff-84e9-61c08fd5a5b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.208971 May 09 10:14:07.697386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1154/2303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:07 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:07.705055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:07.705954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:07.710400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b7781f62-2316-4e78-b2fa-b0a62c28995e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.123050 May 09 10:14:07.711366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1150/2304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:07.716747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:07.717564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.719062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:07.719968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:07.871059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:07.880063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-424ac0f4-ae17-48dd-918b-5d92c0f0d789 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.181288 May 09 10:14:07.880716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1155/2305] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:07 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:08.200877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:08.201408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:08.207968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.208426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.209238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.209677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.444198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:08.458442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:08.461060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:08.462995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-04a27dc7-3055-42cd-9ec7-3e618ad567b0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1802 microversion: 2.20 time: 0.266314 May 09 10:14:08.463913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1151/2306] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1802 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:08.716400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:08.717315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:08.726436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.727507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.728429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.729572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.740114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:08.742319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:08.754186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.755197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.757317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.757604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.872749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:08.896746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19870943-4874-43eb-9624-6ed49fd86ee8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.163556 May 09 10:14:08.898678 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1152/2307] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:08.916459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:08.918642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:08.926904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.927402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.928210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:08.928700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:08.932871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:08.947843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94b38512-7425-4002-9bc4-7f3f23b3b3ba tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.235409 May 09 10:14:08.949403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1156/2308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:09.262334 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:09.271126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e877e23d-3abd-4058-8dc1-4669c47efca4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.364776 May 09 10:14:09.271696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1153/2309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:09.485864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:09.486721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:09.495454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.496178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:09.497703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.498334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:09.640726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:09.644692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-80bea713-0b76-4af3-bdec-cecf28f6d807 req-a13df7c5-a923-403d-b487-50142befff46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129ee65-9b99-4722-9747-26e9e1419653", "name": "network-vif-deleted", "tag": "d49f15ad-9946-4586-aa8f-56bcf27939ed"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:14:09.677473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:09.681961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:09.684477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-89aca87b-6a0a-4173-90d5-b4551b7e0231 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1735 microversion: 2.20 time: 0.203671 May 09 10:14:09.686010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1157/2310] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:09.692332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-80bea713-0b76-4af3-bdec-cecf28f6d807 req-a13df7c5-a923-403d-b487-50142befff46 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.693166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-80bea713-0b76-4af3-bdec-cecf28f6d807 req-a13df7c5-a923-403d-b487-50142befff46 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:09.716119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-80bea713-0b76-4af3-bdec-cecf28f6d807 req-a13df7c5-a923-403d-b487-50142befff46 service nova] Creating event network-vif-deleted:d49f15ad-9946-4586-aa8f-56bcf27939ed for instance 2129ee65-9b99-4722-9747-26e9e1419653 on hv-cinder-84108 May 09 10:14:09.725545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-80bea713-0b76-4af3-bdec-cecf28f6d807 req-a13df7c5-a923-403d-b487-50142befff46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097081 May 09 10:14:09.726549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1154/2311] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:14:09.927225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:09.928303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:09.939147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.939927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:09.941180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.941726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:09.968506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:09.970315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:09.978644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.979096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:09.979875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:09.980473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:10.029739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:10.039098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4014d676-8be4-48fa-af99-0e3b7d6f9250 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.118869 May 09 10:14:10.039691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1158/2312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:10.130274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:10.141719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6756fec4-4a47-4fc1-a097-cf9283ad0e99 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.178037 May 09 10:14:10.142796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1155/2313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:10.289156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:10.289933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:10.296566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:10.297083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:10.297960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:10.298389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:10.489655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:10.498273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe70e68a-23d9-4d19-8416-0f6258e34a57 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.212995 May 09 10:14:10.499092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1159/2314] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:10 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:10.709735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:10.710873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:10.721732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:10.722842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:10.724298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:10.725139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:10.829530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:10.841781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:10.843319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:10.844763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f67e2c73-9b94-4351-96e7-170a4c2bc6cf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.142372 May 09 10:14:10.845365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1156/2315] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:11.057956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:11.058695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:11.066203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.066683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.067498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.067966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.141036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:11.150073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b642767c-f509-4162-a0d9-7ee867e1ab50 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096334 May 09 10:14:11.150689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1160/2316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:11.159508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:11.160134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:11.167095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.167580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.168369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.168862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.326517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:11.341078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-219e936c-9ee0-47dd-bfaa-f3d9d59b5da2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.185051 May 09 10:14:11.342086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1157/2317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:11 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:11.517300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:11.517804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:11.524606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.525103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.525898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.526343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.678191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:11.686786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9743ee6f-472b-4f79-a4a0-109e35bd66f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.173639 May 09 10:14:11.687383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1161/2318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:11 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:11.872699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:11.873285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:11.880321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.880824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.881628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:11.882073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:11.963400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:11.973614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:11.975141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:11.976317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91b234ee-734b-4a70-92b5-86a4b9e34f8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.107832 May 09 10:14:11.976926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1158/2319] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:12.174537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:12.175198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:12.184114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:12.184114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:12.184114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:12.184114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:12.250432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:12.258904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e494500c-7c50-459d-baeb-8c0aa982aa7b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088351 May 09 10:14:12.259486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1162/2320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:12.367848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:12.368821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:12.375934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:12.376414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:12.377233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:12.377659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:12.522437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:12.530932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf0bb4b8-65f5-43a4-b676-e9da7cabe27e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167109 May 09 10:14:12.531592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1159/2321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:12.704818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:12.705602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:12.712610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:12.713014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:12.713814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:12.714257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:12.860566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:12.869199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d627a5a8-7074-4ec1-8b6f-bcd96a44450f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.168367 May 09 10:14:12.869807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1163/2322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:12 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:12.995687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:12.996355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:13.003322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.003784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.004583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.005057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.071734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:13.081379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:13.083857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:13.085309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0fd12ac8-13e8-4852-9b23-1310c167eacd tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094309 May 09 10:14:13.085870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1160/2323] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:13.276186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:13.276860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:13.283763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.284211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.285023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.285453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.352698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:13.363363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7b167c42-dc43-48de-a149-720cdcd28b5f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091125 May 09 10:14:13.363956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1164/2324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:13.551175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:13.551845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:13.558977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.559451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.560249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.560686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.701636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:13.710123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-de8bee30-d21e-4744-8ae8-96db24f49496 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162948 May 09 10:14:13.710792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1161/2325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:13.891074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:13.892143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:13.902723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.903524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:13.904999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:13.905777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.052977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:14.062663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9e440ed8-4c86-45a1-a4e0-8cb5e77832e7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.178864 May 09 10:14:14.063433 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1165/2326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:13 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:14.114297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:14.115021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:14.122060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:14.122515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.123311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:14.123749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.195692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:14.211584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:14.214582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:14.216810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a898cfb5-06e1-43c2-8b71-59c88470102b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.106319 May 09 10:14:14.217742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1162/2327] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:14.383082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:14.383915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:14.390949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:14.391397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.392181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:14.392616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.461913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:14.471911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-24be6141-f337-49b7-96c3-3d215ee43e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092609 May 09 10:14:14.472865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1166/2328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:14.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:14.729086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:14.736498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:14.736988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.737879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:14.738324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:14.878273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:14.886922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-39f2a85b-3295-45ca-8f00-3b6b7101f9f2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162674 May 09 10:14:14.887721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1163/2329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:15.087754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:15.088370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:15.095477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.095963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.096757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.097573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.243875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:15.244263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:15.245022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:15.251741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.252271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.253096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.253535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.256777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-61b9618e-2d48-40ff-9456-5675876296d6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172606 May 09 10:14:15.257765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1167/2330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:15 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:15.338647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:15.348640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:15.350183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:15.351369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab673d18-035c-48dd-8362-d1b2f65af77c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.111104 May 09 10:14:15.351941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1164/2331] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:15.496777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:15.497871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:15.505308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.505914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.506896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.507430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.587828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:15.596541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-815c9939-6f35-41ba-bd72-757ce427d52d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.103934 May 09 10:14:15.597086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1168/2332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:15.907383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:15.908270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:15.918809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.919585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:15.920947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:15.921745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.082805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:16.091041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1912d59-be83-4f9f-8642-6207a92926b0 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.189925 May 09 10:14:16.091664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1165/2333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:16.282750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:16.283388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:16.290434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:16.290886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.291682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:16.292120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.370536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:16.371157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:16.378749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:16.379206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.380000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:16.380436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.464258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:16.470515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:16.474386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5d143fe-bf95-43ca-8419-59703fb63c2f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.195751 May 09 10:14:16.479680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:16.480330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1169/2334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:16 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:16.481229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:16.482405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f7488976-4f51-469b-88db-e4da7c7365b2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.116033 May 09 10:14:16.483277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1166/2335] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:16.614811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:16.615496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:16.623007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:16.623455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.624253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:16.624699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:16.693220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:16.702054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-83f63169-4b8d-4948-9dd7-c54165dae40b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091233 May 09 10:14:16.702652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1170/2336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:17.109949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:17.110987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:17.118270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.118716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.119504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.119935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.258722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:17.267461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6531e6a0-c945-4fd8-b4db-735b7a7ef3db tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161975 May 09 10:14:17.268024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1167/2337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:17 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:17.500121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:17.500700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:17.501903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:17.502747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:17.508437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.508981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.509783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.510232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.510922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.511484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.512460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.513126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.616716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:17.632811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:17.635999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:17.638083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-812140d6-8805-4743-ae8c-fba162a4ab1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.140540 May 09 10:14:17.638924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1168/2338] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:17 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:17.682310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:17.691811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4d90bd2-efcf-4991-80bd-6c1fd50ee8da tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.195800 May 09 10:14:17.692398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1171/2339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:17 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:17.719834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:17.720475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:17.728178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.728696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.729578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:17.730043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:17.796602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:17.805272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-65990510-ef31-44d1-a625-a481d4f6f6fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089479 May 09 10:14:17.805826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1169/2340] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:18.285809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:18.286416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:18.293326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.293781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.294572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.295010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.445670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:18.460006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c63f6d3-441f-46b8-bfd1-0410097af0d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.177763 May 09 10:14:18.460979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1172/2341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:18 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:18.664404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:18.665239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:18.672209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.672815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.673607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.674055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.718559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:18.719602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:18.728368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.728986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.729914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.730447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.745789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:18.757381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:18.759557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:18.761177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ebe5ab8-ea31-459f-bb77-320ca4257c4f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.100692 May 09 10:14:18.761935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1170/2342] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:18.822167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:18.822882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:18.830116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.830590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.831473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:18.831893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:18.904246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:18.921946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d1e27d7-e631-43a1-9727-59a366b64b49 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.207666 May 09 10:14:18.923141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1173/2343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:18 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:18.926070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:18.936555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a920fced-a7de-4c4c-ba99-57f5f8fc1df3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.118041 May 09 10:14:18.937391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1171/2344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:19.479207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:19.479840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:19.486541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.487005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.487784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.488215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.642833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:19.651709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2348d7f-8f2b-43c1-ad9d-f30a757ba412 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.176403 May 09 10:14:19.652302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1174/2345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:19.784001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:19.784636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:19.791912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.792363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.793191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.793608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.861935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:19.871133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:19.872713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:19.873888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4fa76611-4b94-4cab-9681-681c0b234531 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094078 May 09 10:14:19.874462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1172/2346] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:19.943217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:19.943893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:19.951174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.951662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.952501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.952974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.958660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:19.959738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:19.969733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.970471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:19.971705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:19.972761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:20.061261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:20.069836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-663f053c-2525-4565-aafc-cb066cd1666c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.118296 May 09 10:14:20.070752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1173/2347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:20.128903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:20.137377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-27497c0d-85b2-4eee-a0ba-8e1abaff467e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.198198 May 09 10:14:20.137958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1175/2348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:19 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:20.671190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:20.671932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:20.678930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:20.679383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:20.680174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:20.680631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:20.826996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:20.835783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c81c8d5-2fac-44e0-b0c3-57a2c83d19f9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168745 May 09 10:14:20.836393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1174/2349] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:20.893280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:20.893893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:20.900957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:20.901410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:20.902190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:20.902624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:20.973262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:20.982752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:20.984421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:20.985717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-df1080b5-2936-4159-bb40-89e65106d053 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096697 May 09 10:14:20.986578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1176/2350] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:21.087721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:21.088385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:21.095323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:21.095747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:21.096555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:21.097027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:21.157853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:21.158629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:21.168470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:21.169094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:21.169277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:21.170155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:21.170740 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:21.179519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8031e38b-afa9-4bfe-8afa-b14ef398b1fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095528 May 09 10:14:21.180218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1175/2351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:21.324027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:21.333350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-107b828a-bf5a-4334-a8af-13cbee1bedb3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.179942 May 09 10:14:21.333964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1177/2352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:21 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:21.854094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:21.854681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:21.861617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:21.862052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:21.862832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:21.863262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.007498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:22.008368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:22.008569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:22.015834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:22.016349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.017236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:22.017785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.018223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b577cba8-adfa-4bd1-9309-3b60e33c4e22 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.168082 May 09 10:14:22.018960 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1176/2353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:22.086599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:22.095348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:22.096882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:22.098352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-52c4f7ba-df8a-4e7c-81b1-94f74dc0bead tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096484 May 09 10:14:22.098926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1178/2354] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:22.197730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:22.198326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:22.205588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:22.206120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.206946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:22.207506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.276718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:22.285628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c41a38c-f0e8-4fc6-b5be-926c6f06a50d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092152 May 09 10:14:22.286237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1177/2355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:22.351723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:22.352574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:22.359798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:22.360278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.361142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:22.361584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:22.517582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:22.526241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5f5b229-c814-4a3d-adc6-6493be2cd844 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.178828 May 09 10:14:22.526866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1179/2356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:22 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:23.037633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:23.038585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:23.046257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.046777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.047739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.048177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.120455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:23.121647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:23.132147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.133487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.135920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.136454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.205765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:23.221046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:23.224074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:23.226250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a52c3478-a382-4f5e-bbbc-2bfaeab2f158 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.112270 May 09 10:14:23.227399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1180/2357] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:23.238367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:23.248281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a4540ae7-b47d-42b0-8088-532a424e09bf tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.214706 May 09 10:14:23.248997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1178/2358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:23 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:23.303165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:23.303672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:23.311213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.311730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.312562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.313216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.382366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:23.394736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fb9a1a74-a069-4c6a-92e8-6ba62c496f75 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095324 May 09 10:14:23.395589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1181/2359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:23.544764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:23.545673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:23.552881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.553401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.554107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:23.554566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:23.699634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:23.708293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5b7aa527-2805-44e5-bfec-c14c38bb1ed6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.168013 May 09 10:14:23.708913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1179/2360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:23 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:24.250630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:24.251477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:24.259231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.259732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.260560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.261177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.267412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:24.268450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:24.276383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.279687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.280352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.281047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.338927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:24.348925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:24.350603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:24.352116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e80bdfa-5832-4a89-9e4c-b70df908038d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.105585 May 09 10:14:24.353102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1182/2361] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:24.422111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:24.423224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:24.433529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.434233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.435588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.436366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.440178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:24.449690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a457a086-fb94-4189-9c8e-31c370c46888 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.186621 May 09 10:14:24.450469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1180/2362] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:24 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:24.503112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:24.511652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8af06ca3-6758-41fa-b1df-d316dab17dd2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096280 May 09 10:14:24.512273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1183/2363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:24.730462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:24.731590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:24.742800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.743576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.745063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:24.745841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:24.917749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:24.927214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-df90d6f3-fc04-4576-9c3e-ec6100aedac3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.204640 May 09 10:14:24.927813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1181/2364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:24 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:25.374043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:25.374732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:25.385435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.385929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.386779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.387498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.456930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:25.466148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:25.467688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:25.469020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e43c1723-85a1-4b52-820c-9d7565ddf6c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.098983 May 09 10:14:25.469634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1184/2365] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:25.469829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:25.470557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:25.477479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.477918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.478701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.479132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.529842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:25.530618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:25.540044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.540732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.541939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.542649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.628789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:25.638286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:25.642301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4718844d-ea52-4ef1-ada7-a8a0e799fa6c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.116392 May 09 10:14:25.643117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1185/2366] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:25.648386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab6088d8-d87e-4594-b3c5-4d64c2544e0e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.183309 May 09 10:14:25.649079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1182/2367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:25.945734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:25.946253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:25.953053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.953595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:25.954365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:25.954810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.096308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:26.104927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0a710520-dcc7-4c44-a41e-f599b560af0d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.163202 May 09 10:14:26.105519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1186/2368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:25 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:26.495973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:26.496790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:26.504112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:26.504564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.505381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:26.505816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.571307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:26.580280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:26.581816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:26.582973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e78de3b9-2f7f-427c-a1cd-f95a06afff99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091760 May 09 10:14:26.583505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1183/2369] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:26 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:26.659890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:26.660486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:26.665725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:26.666338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:26.667307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:26.667763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.668566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:26.669017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.672453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:26.672955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.673698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:26.674125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:26.743798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:26.751836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b4bd30b-7295-489a-9c9c-212627a0aa73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095861 May 09 10:14:26.752592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1187/2370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:26.815369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:26.824177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c4a11456-f9ce-496e-8ed5-0688b43adf51 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.162291 May 09 10:14:26.824815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1184/2371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:27.123076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:27.123697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:27.130453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.130890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.131687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.132117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.288473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:27.297667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c2b9050-eb54-481d-b5f8-c221c74cf984 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.178637 May 09 10:14:27.298308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1188/2372] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:27 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:27.602261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:27.602930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:27.610000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.610429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.611229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.611664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.677582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:27.686651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:27.688241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:27.689420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e387f169-04df-4832-af6f-0f7a6204ee3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091202 May 09 10:14:27.689942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1185/2373] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:27.769121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:27.769752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:27.776543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.777037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.777812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.778254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.842921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:27.845829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:27.846478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:27.853010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-66adc9d6-1991-4941-9aba-c1d5833f73eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087736 May 09 10:14:27.853384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.853763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.853962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1189/2374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:27.854571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:27.855094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:27.994597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:28.008190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-29c5fc91-9687-4da6-8e28-068a1b495ac1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.165913 May 09 10:14:28.009188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1186/2375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:28.316698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:28.317352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:28.323733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:28.324182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:28.325002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:28.325446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:28.469798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:28.482145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c2b9c36-5cb3-4b2f-b509-97b3b05ae8a0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.171168 May 09 10:14:28.482744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1190/2376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:28 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:28.708359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:28.709020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:28.715982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:28.716462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:28.717275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:28.717705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:28.782187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:28.791421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:28.792971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:28.794144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ba6f7f8-a002-4b60-91a4-383f949fd088 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.090194 May 09 10:14:28.794723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1187/2377] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:28.871210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:28.871859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:28.879238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:28.879683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:28.880452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:28.880929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:28.949894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:28.958575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-38348786-8fd3-4e52-89ad-d2003301c164 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091335 May 09 10:14:28.959045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1191/2378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:29.031794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:29.032419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:29.039172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.039630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.040409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.040901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.190177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:29.198986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6f35e98c-db15-4c4e-8520-bc8f4be39744 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.171118 May 09 10:14:29.199588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1188/2379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:29 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:29.500152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:29.500810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:29.507355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.507794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.508576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.509054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.644720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:29.653173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d91f1ef4-e47b-4d4c-97df-64602c716476 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157177 May 09 10:14:29.653757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1192/2380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:29 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:29.812978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:29.813886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:29.820585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.821051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.821861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.822296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.886470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:29.895697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:29.897543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:29.898862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cfecc639-e340-40be-94f2-6a08ff1fc698 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.089905 May 09 10:14:29.899404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1189/2381] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:29.980300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:29.981495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:29.993520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.994308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:29.995739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:29.996518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:30.078551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:30.087452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7fdb83f-c9d0-4cc8-ae98-166c8341c91f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.115014 May 09 10:14:30.088023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1193/2382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:30.218745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:30.219396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:30.226165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:30.226621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:30.227412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:30.227866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:30.377178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:30.386231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-977a0ad6-0138-4042-85a8-3313a9a53038 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.171433 May 09 10:14:30.386841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1190/2383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:30 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:30.670618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:30.671140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:30.677945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:30.678399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:30.679180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:30.679613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:30.822520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:30.835853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1737ce74-b267-413d-9df9-dd9fc8df1bea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.168841 May 09 10:14:30.836904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1194/2384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:30 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:30.917520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:30.918180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:30.926025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:30.926323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:30.927085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:30.927522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:31.000890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:31.009986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:31.011513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:31.012717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-885ae40d-7bcd-4c35-a0c9-4bf50e0ab554 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.099217 May 09 10:14:31.013286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1191/2385] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:31.105087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:31.105753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:31.112847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:31.113295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:31.114080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:31.114512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:31.181121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:31.190059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2a19ea06-38af-4217-84f6-9c413c89a18b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088875 May 09 10:14:31.190761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1195/2386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:31.403817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:31.404437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:31.411578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:31.412030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:31.412907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:31.413353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:31.563730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:31.572900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6842af9-d572-482c-850e-7d587f9fce2d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.173005 May 09 10:14:31.573533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1192/2387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:31 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:31.866006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:31.867180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:31.878084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:31.878820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:31.880144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:31.880878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.040598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:32.041519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:32.047782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:32.048239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.049065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:32.049513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.054244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:32.064300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-611538f8-201f-430d-bcef-a410a4cf745f tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.205837 May 09 10:14:32.065362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1196/2388] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:31 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:32.118572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:32.127868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:32.129421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:32.130597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-292b58e5-9ff4-47a4-88be-f48d4b3d8d05 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094758 May 09 10:14:32.131168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1193/2389] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:32.208118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:32.208864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:32.216305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:32.216798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.217599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:32.218041 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.295255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:32.304249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a12190e4-80fb-4df1-ac88-26f1227580bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.100082 May 09 10:14:32.305252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1197/2390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:32.590893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:32.591501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:32.598977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:32.599458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.600287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:32.600766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:32.738409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:32.747158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-23f40c58-49ed-4b8e-a39a-db59a433fdd2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.160304 May 09 10:14:32.747822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1194/2391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:32 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:33.087084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:33.088205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:33.099194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.099967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.101211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.101920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.150226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:33.151370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:33.160113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.160937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.161987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.162522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.276560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:33.291707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:33.295009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:33.296236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ff83eef-b8cb-45e3-bd31-a7a0bb4e6180 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.150079 May 09 10:14:33.297070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1195/2392] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:33.298796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:33.312533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f2c2855-e398-42d0-9835-2abbbf12e554 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.232206 May 09 10:14:33.313634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1198/2393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:33 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:33.322406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:33.323235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:33.329919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.330375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.331161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.331618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.409086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:33.417852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e70692b9-3de7-413b-93d4-5943cacd998d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099349 May 09 10:14:33.418716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1196/2394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:33.765127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:33.765679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:33.772521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.773049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.773867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:33.774363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:33.918980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:33.927839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6424046e-8f71-41f2-a32f-eb38949d1c3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166816 May 09 10:14:33.928491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1199/2395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:33 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:34.319053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:34.320123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:34.328335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.328996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.329928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.330481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.344435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:34.345699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:34.358130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.358751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.360184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.360943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.408689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:34.418270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:34.419867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:34.421270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2834d8c9-8994-4b15-a839-611e7bde5842 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.106500 May 09 10:14:34.422080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1197/2396] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:34.439172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:34.439976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:34.447022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.447738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.448742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.449291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.538047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:34.550636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac446764-0f08-4592-b169-9a414455ace4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.117608 May 09 10:14:34.551368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1198/2397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:34.580519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:34.594652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e7d31fb1-d8a4-4b61-bb93-8d22431a2e65 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.257478 May 09 10:14:34.595599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1200/2398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:34.945894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:34.946438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:34.953076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.953536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:34.954335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:34.954766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.099564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:35.108961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cfcf5592-3c5d-454b-917c-b3608d674bac tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167236 May 09 10:14:35.109689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1199/2399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:34 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:35.443782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:35.444416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:35.454793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:35.455243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.456023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:35.457033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.524425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:35.533833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:35.535376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:35.536538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d74a86b2-0d87-41bf-9e24-ad4707e76127 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096806 May 09 10:14:35.537151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1201/2400] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:35.573870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:35.574493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:35.581513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:35.581937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.582741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:35.583178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.619007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:35.619654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:35.626620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:35.627071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.627876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:35.628314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:35.649753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:35.657792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b536ea04-f98b-4d44-a1bc-4f5f18b47937 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087813 May 09 10:14:35.658375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1200/2401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:35.782686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:35.791757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a18db2bd-effd-40a6-b9da-20cc4e1c4bcd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.176533 May 09 10:14:35.792423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1202/2402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:35 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:36.126970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:36.127575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:36.134305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.134758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.135536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.135967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.274086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:36.282640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ea73359-b737-4dbd-8eec-d11a1e61d275 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159716 May 09 10:14:36.283195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1201/2403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:36 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:36.555557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:36.556182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:36.563120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.563579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.564351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.564812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.632310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:36.641888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:36.643295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:36.644452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca6aa24a-a6dc-40bb-9c0d-3b60651ec66a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.092965 May 09 10:14:36.645047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1203/2404] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:36 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:36.674091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:36.674708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:36.681442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.681887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.682665 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.683099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.747899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:36.756510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-014c311b-3e94-47a5-a52e-2ef3c362680e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086287 May 09 10:14:36.757145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1202/2405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:36.818152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:36.818790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:36.825460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.825906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.826683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:36.827117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:36.960809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:36.969501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e7c656c5-fbab-430b-b331-b631404a2d23 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155197 May 09 10:14:36.970096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1204/2406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:36 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:37.299720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:37.300781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:37.308409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.308861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.309657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.310081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.452895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:37.462235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5ec08718-738f-41d2-8c56-bf0580626ff4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166421 May 09 10:14:37.462888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1203/2407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:37.675522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:37.676624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:37.688350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.689183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.690568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.691336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.772619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:37.777479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:37.778315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:37.787352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:37.788978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.789691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.790154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:37.790956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.791664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.792112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e30fc771-3d3f-40d5-bd63-16efcfafe62f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.124156 May 09 10:14:37.793038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1205/2408] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:37.862080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:37.871405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25bd112f-8951-472b-9411-e829619e70f8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.100508 May 09 10:14:37.872197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1204/2409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:37.987100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:37.987754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:37.994906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.995423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:37.996348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:37.996876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.135174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:38.143679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a18f842a-af9a-456b-b343-ce4e76685ffd tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160850 May 09 10:14:38.144271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1206/2410] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:37 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:38.479707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:38.480321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:38.487291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:38.487802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.488637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:38.489184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.636177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:38.645441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4238b120-edba-4be1-8999-997ef53f8653 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.169565 May 09 10:14:38.646030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1205/2411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:38 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:38.812506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:38.813242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:38.820161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:38.820639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.821459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:38.821931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.888205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:38.890131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:38.890993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:38.898624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:38.899157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.899527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:38.900075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:38.900564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:38.901497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:38.903040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dabe6d7e-134e-4b1a-aa24-e8907a8555f8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094565 May 09 10:14:38.903856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1207/2412] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:38.976875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:38.985436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7b8038da-4fa8-4cd1-9818-0c40ec2a9ad7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099474 May 09 10:14:38.986028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1206/2413] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:39.162615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:39.163126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:39.170738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:39.171259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:39.172223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:39.172720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:39.338120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:39.347375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f919ecb4-046c-44ea-82ba-0c957d463b88 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.188841 May 09 10:14:39.347954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1208/2414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:39.663644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:39.664263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:39.671072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:39.671624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:39.672413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:39.672898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:39.815370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:39.824530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-394f2bc8-7c70-423d-9a9f-99ef0e62a1a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164876 May 09 10:14:39.825173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1207/2415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:39.929213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:39.930253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:39.938078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:39.938547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:39.939331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:39.939788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:40.008043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:40.013700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:40.014838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:40.022591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:40.025420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:40.025875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:40.026704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:40.027397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0828ebd-6830-44b1-a8e2-65f69daed078 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.102146 May 09 10:14:40.028172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:40.028374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1209/2416] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:40.029107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:40.100396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:40.108696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1c7aac2-167c-40b3-a386-d2ac2f03f27b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.101792 May 09 10:14:40.109357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1208/2417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:40.369015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:40.369883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:40.379566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:40.380241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:40.381511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:40.382168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:40.543045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:40.553434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d9b894a6-90ac-4934-860a-49f2f262a347 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.190917 May 09 10:14:40.554282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1210/2418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:40 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:40.842623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:40.843232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:40.850448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:40.850895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:40.851694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:40.852126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.006936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:41.016009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d502f913-1bbd-4cc1-8de5-97099d7e519e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.177317 May 09 10:14:41.016994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1209/2419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:40 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:41.054933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:41.055607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:41.063285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:41.063734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.064600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:41.065064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.125972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:41.126688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:41.134925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:41.135460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.136504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:41.137076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.149451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:41.164064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:41.166641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:41.168302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c4fd7b7-d510-4456-a939-a94af7afecd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.118737 May 09 10:14:41.169397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1211/2420] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:41.217626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:41.227066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e043034-4e4c-4bfa-a560-e8d7a48e0df1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.105035 May 09 10:14:41.227577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1210/2421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:41.572214 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:41.573229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:41.579960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:41.580410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.581238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:41.581682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:41.728951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:41.738907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9622d33b-0f46-4503-bfdb-11ae5e40a4cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.170571 May 09 10:14:41.739562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1212/2422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:41 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:42.038227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:42.039163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:42.050418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.051130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.052492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.053290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.193119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:42.194172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:42.204069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.204492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.205338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.205777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.222214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:42.230835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1dfb5c3c-5a5e-4905-824a-15b812b487b6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.200631 May 09 10:14:42.231410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1211/2423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:42 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:42.251331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:42.251975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:42.259044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.259493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.260265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.260794 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.270842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:42.279724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:42.281311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:42.282487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e2746b05-7332-4de1-8a68-8bdb4d32b80f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096579 May 09 10:14:42.283054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1213/2424] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:42.324476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:42.333295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d22a9ef3-92e5-4bc9-8a00-752add366569 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085924 May 09 10:14:42.333852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1212/2425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:42.755952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:42.756470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:42.762998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.763447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.764227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:42.764689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:42.921596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:42.929674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51e567c4-8e0e-4936-9576-ff0c7f979579 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.177670 May 09 10:14:42.930276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1214/2426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:42 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:43.251246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:43.252217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:43.261700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.262247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.263301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.263917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.301395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:43.301996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:43.308979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.309446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.310200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.310692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.376648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:43.387284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:43.388954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:43.390383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d35d818c-1e03-4e68-8ef9-4dee24470aaa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.092885 May 09 10:14:43.391227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1215/2427] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:43.395532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:43.396209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:43.402749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.403192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.403963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.404390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.422646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:43.431064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6d69317-9eb9-4584-97bb-9c58d07cd15c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.185953 May 09 10:14:43.431766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1213/2428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:43 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:43.469707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:43.478859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45c1f5d5-78a7-43fd-bbad-93a03205c59b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086891 May 09 10:14:43.479493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1216/2429] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:43.947621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:43.948114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:43.955087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.955554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:43.956351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:43.956834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.095324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:44.104560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c7c5b155-bb4a-4db1-b020-2f3fc22e9fe6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161123 May 09 10:14:44.105207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1214/2430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:43 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:44.410810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:44.411587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:44.418694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:44.419167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.420020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:44.420465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.457725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:44.458783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:44.466443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:44.467172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.468418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:44.468999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.507101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:44.519713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:44.521953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:44.523341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-06f605b9-013a-4db0-97bd-060fc9e2524b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.117962 May 09 10:14:44.524743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1217/2431] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:44.530421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:44.531379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:44.538893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:44.539372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.540186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:44.540627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:44.617003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:44.626553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-144dab7c-c7bb-49f8-a0b1-5580bfc7ca8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.101428 May 09 10:14:44.627317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1218/2432] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:44.659038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:44.668207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-479d6dca-475a-41e1-96e1-a267a7e966b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.214565 May 09 10:14:44.668834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1215/2433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:45.123084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:45.123695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:45.130806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.131259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.132048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.132466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.279577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:45.290043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4da62fa-90b5-4c01-9d44-3010240c6934 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.170899 May 09 10:14:45.290647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1219/2434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:45 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:45.550965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:45.551646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:45.558757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.559221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.560055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.560527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.628998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:45.638372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:45.640135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:45.641462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35550d50-16ab-424d-beba-18fe1e90bc92 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094641 May 09 10:14:45.642047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1216/2435] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:45 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:45.646959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:45.647659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:45.655149 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.655607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.656405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.656930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.689986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:45.691097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:45.700338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.701013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.702820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:45.703782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:45.740035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:45.749020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ddac9c6-dd98-499d-8112-97f44ed3ae6b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.106234 May 09 10:14:45.749715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1220/2436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:45.861692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:45.876831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7982dee0-5afd-47ce-bbd4-11e790d6fbd5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.193984 May 09 10:14:45.877878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1217/2437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:46.308694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:46.309544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:46.317238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.317689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.318500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.318919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.478298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:46.487960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f8bda001-94f8-4887-81f3-b605fc201346 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.183610 May 09 10:14:46.488582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1221/2438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:46.669757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:46.670613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:46.677583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.678040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.678851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.679305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.749085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:46.758566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:46.760116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:46.761317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4dd33993-9a47-44db-bb91-466c27e700d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.095602 May 09 10:14:46.761861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1218/2439] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:46.771386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:46.772579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:46.783292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.783902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.784783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.785266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.854665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:46.863331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56a6c687-3164-4fe9-b956-f4dd6a30ff65 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099341 May 09 10:14:46.863913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1222/2440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:46.895507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:46.896208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:46.903333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.903846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:46.904690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:46.905289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.046457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:47.055746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c948cbff-fafe-4720-8ae6-0b22a145485c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164430 May 09 10:14:47.056384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1219/2441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:47.506247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:47.506785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:47.513345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:47.513804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.514583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:47.515054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.667019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:47.675802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d31fb7e-d967-46c6-81b8-b30698ac3ff2 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.173508 May 09 10:14:47.676398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1223/2442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:47 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:47.789729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:47.790419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:47.797784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:47.798236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.799038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:47.799499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.866102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:47.875618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:47.877424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:47.878643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e350791-86c7-4948-9d73-7a2790fc67ac tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.093193 May 09 10:14:47.879468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1220/2443] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:47.883917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:47.885073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:47.897444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:47.898256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.899225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:47.899690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:47.967877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:47.977132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c69de33b-66fb-43d8-a13e-a669ff02b96f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099316 May 09 10:14:47.977725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1224/2444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:48.080249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:48.080799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:48.087593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:48.088121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:48.088878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:48.089317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:48.240909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:48.249786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-98034f85-a50e-49fb-ac8d-1bf8b8f4beae tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.173499 May 09 10:14:48.250379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1221/2445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:48 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:48.702010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:48.702657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:48.709806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:48.710467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:48.711285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:48.711717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:48.854799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:48.863000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb38c065-9ac9-4b74-a33e-c6aab1edf3f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.165125 May 09 10:14:48.863588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1225/2446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:48 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:48.907226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:48.907884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:48.914908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:48.915348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:48.916129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:48.916566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:48.982572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:48.992539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:48.994623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:48.994862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:48.995587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:48.996574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e712402f-3c3f-47fb-8d4a-e9e8c871ee6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.093730 May 09 10:14:48.997676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1222/2447] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:49.002774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:49.003225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:49.004018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:49.004432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:49.075976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:49.084297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a3f520f5-6bba-4d0f-84dd-a17f826c7e3d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093350 May 09 10:14:49.084896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1226/2448] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:49.267438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:49.267955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:49.274529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:49.274985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:49.275752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:49.276181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:49.434072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:49.443550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-028d9dc5-e5e3-45d2-a0b0-877cc447abb9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.180086 May 09 10:14:49.444138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1223/2449] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:49.881070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:49.881602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:49.888551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:49.889021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:49.889781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:49.890302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.021214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:50.022221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:50.029823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:50.030384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.031248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:50.031884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.044691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:50.058492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b5719b3b-4732-467b-91a7-df848631fc84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.181146 May 09 10:14:50.059328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1227/2450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:49 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:50.102664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:50.103364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:50.109876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:50.110676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:50.111169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.111999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:50.112474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.120274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:50.122189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:50.123556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc37550d-908a-49b1-a2db-fb465503857d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.109572 May 09 10:14:50.124163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1224/2451] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:50.191629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:50.201797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef7f4f25-aa56-49a0-ac98-91e7a58cc69f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.103401 May 09 10:14:50.202488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1228/2452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:50.461516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:50.462048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:50.469198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:50.469723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.470595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:50.471043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:50.891386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:50.900333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b861d9a7-c453-48cd-b116-c8b48f687fed tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.442719 May 09 10:14:50.900956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1225/2453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:50 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:51.078656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:51.080401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:51.087169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.087623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.088420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.088897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.151805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:51.152822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:51.161700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.162480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.163352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.164079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.237049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:51.246978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef87d761-d8bd-47ea-a1d2-e04edba05be1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172090 May 09 10:14:51.247726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1229/2454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:51 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:51.249648 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:51.257371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:51.258567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:51.261108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:51.263867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:51.265620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a94071d-42bc-4b8b-b7bd-b911f4d79e6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.119031 May 09 10:14:51.266673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1226/2455] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:51.269390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.270177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.271583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.272376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.354245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:51.363236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-42726e12-1533-4cda-922e-93fc5d7f251b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.114090 May 09 10:14:51.363837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1230/2456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:51.918243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:51.918863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:51.925770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.926228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:51.927012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:51.927450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.064745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:52.073379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b6f6242f-c5bb-412c-a3ed-13e7aa66f0b4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.159141 May 09 10:14:52.073949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1227/2457] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:52.272787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:52.273457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:52.280479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:52.280944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.281753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:52.282178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.296857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:52.297535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:52.304017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:52.304458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.305277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:52.305724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.369765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:52.378883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:52.380376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:52.381564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50c5eac7-d478-4554-9693-3a7e4280f1a0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.092341 May 09 10:14:52.382096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1228/2458] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:52.386637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:52.387290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:52.394079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:52.394354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.395145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:52.395638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:52.418068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:52.428115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7acd1d0-3da3-4ff9-87a0-c5621908553a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159243 May 09 10:14:52.428732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1231/2459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:52 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:52.459398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:52.468133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-34da2112-a8b0-49e6-997a-3be1d41caf8c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084858 May 09 10:14:52.468650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1229/2460] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:53.091367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:53.092043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:53.100076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.100695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.101634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.102114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.255784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:53.264553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-740dbba4-0a7c-4bd5-aa45-77efec16a0fc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.177324 May 09 10:14:53.265191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1232/2461] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:53 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:53.399882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:53.400506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:53.408056 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.408614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.409547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.410036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.455956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:53.458266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:53.473079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.473886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.475336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.476077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.481133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:53.491685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:53.493326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:53.494561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5cf34dea-7162-40ba-820e-7cd2af114948 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.098842 May 09 10:14:53.495143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1230/2462] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:53.500032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:53.500656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:53.507779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.508231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.509080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:53.509510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:53.588918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:53.598991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75ac30da-c908-42d6-a6c0-39c70a27b9e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.102625 May 09 10:14:53.599456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1231/2463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:53.657693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:53.666603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a84faf6d-d77e-4b83-94e6-bd698e8d0de0 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.223509 May 09 10:14:53.667320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1233/2464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:53 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:54.282543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:54.283225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:54.289926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.290390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.291190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.291680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.431144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:54.439862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1de67189-453d-4ac9-b56d-7ad89439ed1c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161442 May 09 10:14:54.440461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1232/2465] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:54.515811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:54.517573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:54.525661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.526105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.526880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.527309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.598420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:54.607804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:54.609417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:54.611261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a375285-e96a-42c0-aef4-73342d20816b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.098914 May 09 10:14:54.611261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1234/2466] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:54.616954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:54.617584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:54.624048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.624506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.625331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.625774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.685168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:54.686035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:54.692996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.693446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.693815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:54.694233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:54.694659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:54.708716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ddeed5bf-b822-4c91-b217-18e61469e6ed tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095311 May 09 10:14:54.709755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1233/2467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:54.840150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:54.855133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f2ddb4ac-a363-460e-ba12-dadea3583f5b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.173856 May 09 10:14:54.856199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1235/2468] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:54 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:55.464693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:55.465339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:55.473664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.474127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.474946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.475390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.625021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:55.635768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79f4967c-7f1c-4727-8553-975e2c005061 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.175208 May 09 10:14:55.636632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1234/2469] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:55 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:55.641127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:55.642254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:55.650601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.651137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.652094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.652611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.723475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:55.735926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:55.737897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:55.738633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:55.738927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:55.740558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3aa358e3-8c50-4b3b-bf81-11b409173baf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.104714 May 09 10:14:55.741530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1236/2470] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:55.749570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.750387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.751839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.752651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.819572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:55.828236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7b84274-8a7b-4872-a427-c61cb5125a16 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.097146 May 09 10:14:55.828858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1235/2471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:55.874705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:55.875609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:55.882933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.883390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:55.884187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:55.884609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.036388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:56.045866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9f74529-cd86-4320-9e90-cc0e457ebdb8 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.175293 May 09 10:14:56.046607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1237/2472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:55 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:56.655459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:56.656094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:56.663095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:56.663559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.664365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:56.664843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.769323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:56.770366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:56.778520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:56.779113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.780011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:56.780614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.808625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:56.819114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1a944c4b-25ba-45ff-94bf-09c66d13a39b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167703 May 09 10:14:56.819727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1236/2473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:56.846110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:56.847163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:56.852370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:56.853596 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:56.854049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.854836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:56.855274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:56.868462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:56.871502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:56.873709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ea81b98-6487-43b4-83da-802b1466e54f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.108833 May 09 10:14:56.874732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1238/2474] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:56 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:56.927709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:56.941877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7db0460b-77db-4aa0-b294-a54740ae4270 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.099924 May 09 10:14:56.942493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1237/2475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:57.064495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:57.065139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:57.072265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:57.072719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:57.073524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:57.073963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:57.216844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:57.225997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-02782e80-13ed-4480-93d8-7799ae180dc1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.165652 May 09 10:14:57.226599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1239/2476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:57 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:57.837311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:57.838239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:57.845639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:57.846105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:57.847215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:57.847639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:57.900192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:57.901213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:57.908825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:57.909406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:57.910474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:57.911669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:57.984069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:57.999322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:58.002203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:58.004367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ba293aa-2a70-4727-bfc1-22ecd7a2adf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.108275 May 09 10:14:58.005466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1240/2477] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:14:58.013935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:58.016278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:58.019286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:58.025644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:58.026265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:58.027177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:58.027824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:58.029673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-342d2489-c4b8-4661-8a55-44442eb34d3e tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.196332 May 09 10:14:58.030501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1238/2478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:57 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:58.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:58.102965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-227ef1f9-9c8a-4aa7-9af4-616e6a7d9162 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096078 May 09 10:14:58.103575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1241/2479] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:58.244064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:58.244768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:58.251689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:58.252094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:58.252948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:58.253385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:58.399653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:58.409465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9134a1e1-5aa4-4067-af54-1b4b007568f6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.169442 May 09 10:14:58.410224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1239/2480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:58 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:59.027241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:59.027887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:59.034925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.035363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.036163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.036607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.050210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:59.051133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:59.059396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.059961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.061105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.061824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.112764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:59.127702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:59.130751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:59.132897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-578b048b-f7e0-4711-800e-97cdff1b2474 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.109283 May 09 10:14:59.133884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1242/2481] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:14:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:14:59.142597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:59.143729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:59.151728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.152284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.153403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.154062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.231366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:59.240026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-831d62e5-a9dc-4fdc-92f8-b96023ed500b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.194389 May 09 10:14:59.240636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1240/2482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:14:59.247109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:59.259948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81bd1692-f18e-4a6a-b0ec-2f44f645aa98 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.124575 May 09 10:14:59.260695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1243/2483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:14:59.427875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:14:59.428395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:14:59.435552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.436108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.437128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:14:59.437617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:14:59.595968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:14:59.605469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37cce010-274f-4a5f-b266-85921364161c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.181560 May 09 10:14:59.606052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1241/2484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:14:59 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:00.154687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:00.155420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:00.162756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.163249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.164009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.164451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.231504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:00.240726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:00.242563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:00.243631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-98cbfaff-ccae-4fc6-b44a-522880f71b35 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.093166 May 09 10:15:00.244186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1244/2485] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:00.268347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:00.269443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:00.278168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.278620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.279469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.279933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.286267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:00.286874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:00.292984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.293428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.294199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.294628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.371786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:00.384847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-781739d8-04b8-440f-890f-684a6552bca6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.102395 May 09 10:15:00.385458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1245/2486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:00.441049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:00.449929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-641c7baa-981b-4157-af6a-cffe02af11f4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.188951 May 09 10:15:00.450534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1242/2487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:00 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:00.623906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:00.624526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:00.631076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.631534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.632322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:00.632796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:00.790770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:00.802244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d2b0b3e-c19d-4322-8e70-07015a324545 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.182210 May 09 10:15:00.803326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1246/2488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:00 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:01.262924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:01.263531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:01.270386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.271145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.271617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.272030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.337343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:01.347278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:01.348821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:01.350011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73ca0bc9-1de6-4346-a6f3-748fc59ee862 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091280 May 09 10:15:01.350581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1243/2489] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:01.402586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:01.403368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:01.410476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.410968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.411839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.412323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.468186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:01.469038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:01.477487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.478230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.479408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.480082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.487138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:01.500244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9d452d8-98c3-458c-865a-ff96a85c6413 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.101334 May 09 10:15:01.501218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1247/2490] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:01.635176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:01.644061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3b70de6f-e754-4bc4-b181-33545807fc8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.180099 May 09 10:15:01.644684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1244/2491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:01.821180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:01.821703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:01.828158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.828630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.829405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:01.829838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:01.973737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:01.982258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6089243e-57c5-41c7-ab9e-397c241fc5a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.165013 May 09 10:15:01.982866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1248/2492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:01 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:02.369463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:02.371120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:02.382644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:02.383429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:02.384848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:02.385631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:02.490949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:02.500532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:02.502136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:02.503315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90f3b926-43cf-483a-8827-8f2f7fe02cc9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.137889 May 09 10:15:02.503897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1245/2493] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:02.522259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:02.523395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:02.534787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:02.535579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:02.537054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:02.537811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:02.609762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:02.618707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6164bb8e-16b0-49b4-b951-f9f868e7e61b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.103632 May 09 10:15:02.619278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1249/2494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:02.661684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:02.662235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:02.669149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:02.669607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:02.670401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:02.670928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:02.813687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:02.823124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f82430cc-ead9-41c4-b394-4f3f9cfba660 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.165900 May 09 10:15:02.823713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1246/2495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:03.003922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:03.004993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:03.013327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.013780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.014605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.015044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.167463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:03.182208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e73d8d7-f713-4419-8812-47aa3f78992b tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.185355 May 09 10:15:03.183215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1250/2496] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:02 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:03.522450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:03.523268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:03.530123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.530581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.531373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.531824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.603369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:03.619206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:03.622192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:03.624351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e0ccb99-52c8-4618-ad4a-548624d80fa7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.105716 May 09 10:15:03.625420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1247/2497] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:03.642125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:03.642806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:03.649986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.650444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.651240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.651681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.720703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:03.730129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1cd4d47-7e0c-4c07-ba9e-e971ce6d306c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092160 May 09 10:15:03.730731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1251/2498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:03.845157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:03.845892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:03.853353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.853888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.854732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:03.855215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:03.997454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:04.006417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c7a37c9-8fc1-4216-a07e-318c3d046c37 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167821 May 09 10:15:04.007013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1248/2499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:04.208467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:04.209116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:04.216709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:04.217247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:04.218186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:04.218673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:04.357920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:04.366266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f9f1248a-4bd4-4afe-8094-8d3128a4a96c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.162149 May 09 10:15:04.366854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1252/2500] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:04 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:04.652362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:04.653106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:04.660808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:04.661359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:04.662300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:04.662843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:04.740588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:04.756232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:04.759236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:04.761391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a563ecc5-aa64-4ea2-97d3-724ed2e960da tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.112737 May 09 10:15:04.762419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1249/2501] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:04.887365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:04.888240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:04.895153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:04.895629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:04.896554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:04.897040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:04.965411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:04.974368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-608015b4-b66e-45fc-b171-c177f0c85241 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.230576 May 09 10:15:04.974968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1253/2502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:05.023734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:05.024348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:05.031418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:05.031880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:05.032697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:05.033142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:05.178373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:05.187234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-972c7ef9-6d83-4080-8816-3562ae3304f8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167375 May 09 10:15:05.187828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1250/2503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:05 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:05.384210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:05.385003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:05.391924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:05.392431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:05.393251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:05.393684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:05.531581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:05.540063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-37f5ce66-0507-4983-9a64-f6cc262f4a9d tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160123 May 09 10:15:05.540701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1254/2504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:05 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:05.783368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:05.784044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:05.791353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:05.791781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:05.792598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:05.793069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:05.862883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:05.872303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:05.874028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:05.875254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a8463a2-70ee-4f2e-be53-5c3e72a53cd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096162 May 09 10:15:05.875878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1251/2505] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:05.992153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:05.992842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:06.000046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.000493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.001332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.001764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.072382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:06.086557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f05ec329-4050-4439-9abe-230d63139dc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.098238 May 09 10:15:06.087590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1255/2506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:06.205223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:06.205859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:06.212741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.213189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.213982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.214415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.356337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:06.365181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-84133b10-22b1-49f3-bd83-0d9ce75bbce9 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163821 May 09 10:15:06.365839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1252/2507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:06.558173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:06.558951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:06.566512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.566952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.567728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.568156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.711555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:06.720115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6271b5a-1256-483e-8122-4659b1dbf427 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.166428 May 09 10:15:06.720726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1256/2508] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:06 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:06.894534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:06.895213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:06.902570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.902913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.903754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:06.904194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:06.972712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:06.981728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:06.983407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:06.984621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-35ae83e3-10b9-43b9-82d0-0b02d1d73d8b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094198 May 09 10:15:06.985230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1253/2509] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:06 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:07.105162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:07.105820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:07.112789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:07.113603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:07.114965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:07.115708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:07.185275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:07.195392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-522401b5-0065-4737-837a-3257b9ee14d4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094196 May 09 10:15:07.195958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1257/2510] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:07.383382 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:07.384048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:07.390996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:07.391489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:07.392452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:07.393027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:07.540261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:07.555006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f6a0563-7e0f-432a-9dd0-5a1e8368d91b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.175516 May 09 10:15:07.556057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1254/2511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:07 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:07.741959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:07.743015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:07.753587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:07.754341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:07.755719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:07.756473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:07.926717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:07.935429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf479e7f-4e33-420f-a34c-590d6c925c27 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.200918 May 09 10:15:07.936075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1258/2512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:07 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:08.004362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:08.005044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:08.012305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.012815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.013627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.014170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.082500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:08.094331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:08.095911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:08.097482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f07bebc5-1a0c-4033-b449-0031fdfe2093 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.097213 May 09 10:15:08.098150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1255/2513] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:08.212337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:08.213150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:08.220620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.221661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.222594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.223112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.294627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:08.303837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96752b5f-e1ea-40c1-bfd2-71498c5d8991 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095661 May 09 10:15:08.304611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1259/2514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:08.574777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:08.575379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:08.582420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.582907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.583738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.584253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.802197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:08.811220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adbbbbe1-2dc5-4617-9b0c-bc028f78b615 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.240196 May 09 10:15:08.811730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1256/2515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:08.955155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:08.955945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:08.962926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.963451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:08.964246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:08.964724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.117673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:09.118494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:09.118690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:09.125745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:09.126326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.127200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:09.127962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.132499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f635e134-10ac-4764-b378-fc1091e69437 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.182554 May 09 10:15:09.133600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1260/2516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:09.202556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:09.211544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:09.213081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:09.214247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4235e35f-ad06-4948-9259-c31c9d9ecbd5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.101412 May 09 10:15:09.214849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1257/2517] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:09.321980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:09.322696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:09.329984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:09.330417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.331211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:09.331677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.469820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:09.479550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-484d324d-d109-4623-b224-4dcd758cf0e3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.161508 May 09 10:15:09.480223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1261/2518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:09.828732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:09.829412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:09.836168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:09.836623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.837455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:09.837895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:09.981783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:09.990936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-097bc176-5e2d-4068-8bc8-3027b66e0bbc tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166219 May 09 10:15:09.991758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1258/2519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:09 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:10.151195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:10.151726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:10.158800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:10.159443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:10.160315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:10.160787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:10.237671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:10.238607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:10.248774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:10.249419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:10.250705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:10.251267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:10.317952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:10.333049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3430e26f-f10a-41a5-ab4e-667ee694cbe1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.185781 May 09 10:15:10.334123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1262/2520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:10 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:10.349887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:10.359700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:10.361434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:10.362742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f624253-a9eb-4f9a-a1fa-89f3ab984a86 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.132757 May 09 10:15:10.363367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1259/2521] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:10 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:10.497565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:10.498179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:10.505353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:10.505805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:10.506778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:10.507080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:10.587117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:10.595484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ccccbf5-2d7d-4a99-9f60-4f5f043e8eeb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.101861 May 09 10:15:10.596074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1263/2522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:11.009686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:11.010306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:11.017264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.017714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.018532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.018971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.168459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:11.177415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc85d87a-90a1-43be-abc4-12137eebd3d2 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.171615 May 09 10:15:11.178002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1260/2523] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:11 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:11.352413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:11.353352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:11.361063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.361388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.362180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.362622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.382546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:11.383321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:11.390230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.390724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.391522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.391959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.470802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:11.483384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:11.486085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:11.487809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e72309d7-9c21-4370-b02e-b4c0007ec4bc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.109978 May 09 10:15:11.488520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1261/2524] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:11 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:11.540515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:11.549619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3604c59e-f5ac-4ab8-8c18-a7fc8bd3b884 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.201413 May 09 10:15:11.550224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1264/2525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:11 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:11.613966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:11.614561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:11.621706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.622154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.622945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:11.623581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:11.690763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:11.700540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f3768f9-d2e8-4e8a-b6cd-69235ca56a00 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090585 May 09 10:15:11.701162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1262/2526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:12.195473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:12.196121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:12.203229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.203723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.204490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.204979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.347734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:12.362520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bea21cbd-4e28-416d-bb1c-87bea41aedd8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.170687 May 09 10:15:12.363562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1265/2527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:12 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:12.509305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:12.510217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:12.516861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.517310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.518095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.518531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.575900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:12.576811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:12.584902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.585490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.586391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.587021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.587586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:12.603314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:12.606236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:12.608363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d948d33-6131-4fbb-9735-1e7e74c4d539 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.102869 May 09 10:15:12.609388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1263/2528] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:12 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:12.722873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:12.723818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:12.734498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.735384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.736719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:12.737274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:12.739173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:12.748767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1cc84ad7-e9de-40ac-adcd-9da1c5bd4adc tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.176893 May 09 10:15:12.749362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1266/2529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:12 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:12.803944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:12.812256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b9f53c6a-d7c1-4a6f-82c2-1ca784daa8f3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.097042 May 09 10:15:12.812836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1264/2530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:13.387766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:13.388618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:13.395681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.396140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.397046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.397490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.543884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:13.553427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d91bc59-a5cb-420a-ba8b-c00ff2c26758 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.169598 May 09 10:15:13.554034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1267/2531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:13 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:13.628509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:13.629288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:13.635816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.636269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.637083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.637511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.704500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:13.713869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:13.715389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:13.716558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-414cf5c0-9676-4608-9403-1bd3846b11f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.092064 May 09 10:15:13.717582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1265/2532] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:13 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:13.770857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:13.771785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:13.779446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.779839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.781178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.781658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.830375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:13.830978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:13.837682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.838137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.838925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:13.839649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:13.910473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:13.918893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-acb940b8-5aec-4525-9240-3de605e1b3d3 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092654 May 09 10:15:13.919494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1266/2533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:13.934628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:13.943531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-58716456-c21b-46a5-b2fa-25e42bd29f05 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.177043 May 09 10:15:13.944133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1268/2534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:13 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:14.571868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:14.572494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:14.580536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.580811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.581555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.582012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.745356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:14.746250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:14.756385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.756625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:14.757397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.758541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.759292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.765578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2cd64457-bdcc-403a-97ab-cfa2ad058b6c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.198223 May 09 10:15:14.766166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1267/2535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:14 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:14.827866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:14.837530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:14.839335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:14.841720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9b44412a-0a12-44d2-bb4a-95e69b74b433 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.105937 May 09 10:15:14.842571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1269/2536] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:14 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:14.943069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:14.943977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:14.953827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.954544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.955767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.956443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.961996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:14.962772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:14.969716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.970193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:14.970951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:14.971697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:15.048651 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:15.058895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c5f2a2c-21c9-487c-a0af-561096a3bfba tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.122181 May 09 10:15:15.059711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1268/2537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:15.130066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:15.138833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa58b625-52d1-42f0-8e34-fbd3417e15e4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.180702 May 09 10:15:15.139434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1270/2538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:14 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:15.790776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:15.791599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:15.799135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:15.799632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:15.800466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:15.800992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:15.861832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:15.862682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:15.870114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:15.870636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:15.871885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:15.872514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:15.959275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:15.968898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:15.972172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:15.974741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:15.976708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21ce0f00-b30f-46c5-b00e-78d574ccd34a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.118913 May 09 10:15:15.977638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1271/2539] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:15 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:15.983085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-796feffc-c165-44e2-a925-29ae34becbb1 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.195861 May 09 10:15:15.984163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1269/2540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:15 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:16.085389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:16.086510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:16.097480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:16.098320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:16.099700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:16.100478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:16.164039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:16.164587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:16.171531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:16.172034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:16.172858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:16.173318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:16.214644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:16.224293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-298da3c9-cb18-4e52-a51d-c04bf0c900e8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.146227 May 09 10:15:16.225180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1272/2541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:16.337380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:16.346033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ba3c544a-4058-4e4b-ab52-e554b27578ea tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.185878 May 09 10:15:16.346913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1270/2542] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:16 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:16.999542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:17.000320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:17.001735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:17.002466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:17.009465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.009915 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.010119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.010701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.010903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.011129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.012290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.012899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.112160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:17.122026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:17.123630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:17.124807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee18884c-b2cb-4b04-b239-64ff7cb06e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.129563 May 09 10:15:17.125385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1273/2543] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:16 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:17.173017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:17.182115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5f2072f-72fd-4a77-bf28-f55ad9003de4 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.184130 May 09 10:15:17.182720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1271/2544] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:16 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:17.241994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:17.242611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:17.249764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.250457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.251271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.251732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.317899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:17.327052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23bdd419-28ce-46ca-85d0-baced9897fc0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089068 May 09 10:15:17.327650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1274/2545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:17.365411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:17.366008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:17.373333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.373788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.374638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:17.375076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:17.517275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:17.526100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-36ef9954-937a-418d-a1e5-a25308be48f7 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.165161 May 09 10:15:17.526702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1272/2546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:17 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:18.151932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:18.152721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:18.159695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.160142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.160972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.161408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.205084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:18.206172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:18.217022 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.217813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.219297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.219939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.248364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:18.257542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:18.259123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:18.260311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-07bd8ff5-02cd-472b-b63c-5ec0c1dec02c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.112406 May 09 10:15:18.261168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1275/2547] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:18 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:18.348758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:18.349972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:18.361838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.362587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.363984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.364802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.375103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:18.384108 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb67bce4-33eb-443d-8f10-1eab683b5ee6 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.186359 May 09 10:15:18.384742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1273/2548] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:18 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:18.458679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:18.473580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e111cd9f-0ff4-4472-8565-d41e81c3a93a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.132387 May 09 10:15:18.474583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1276/2549] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:18.555920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:18.557122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:18.566446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.566971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.567876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:18.568420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:18.711590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:18.726635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d12097c-2c28-46a0-aaf0-8309b0713c56 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.177962 May 09 10:15:18.727628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1274/2550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:18 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:19.279664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:19.280341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:19.287352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.287814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.288608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.289084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.354031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:19.363037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:19.364547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:19.365728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5cf10134-8b08-44eb-8d6a-53333bf45e9b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.090388 May 09 10:15:19.366295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1277/2551] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:19 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:19.403985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:19.404995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:19.411639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.412074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.412881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.413308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.492342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:19.493010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:19.500091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.500537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.501529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.501968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.589309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:19.594719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:19.600602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5c3d318a-df91-4861-8a7f-cf488c944eb5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.200701 May 09 10:15:19.601572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1275/2552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:19 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:19.604247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2f2fbc44-7d04-4843-8a0b-8f8bc404f5f0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.116062 May 09 10:15:19.604982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1278/2553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:19.744617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:19.745303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:19.753155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.753943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.755279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:19.755729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:19.910992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:19.919423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3129ad4-e2ad-42e0-a464-7c7ce64266cb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.179208 May 09 10:15:19.920023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1276/2554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:19 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:20.385697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:20.386679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:20.394015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.394505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.395519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.396075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.485485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:20.496619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:20.498569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:20.499904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8baab426-63ac-4462-876a-91387abbcd32 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.118299 May 09 10:15:20.500551 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1279/2555] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:20 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:20.622313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:20.623252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:20.626921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:20.627644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:20.630077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.630533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.631316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.631749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.635144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.635595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.636442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.636872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.700271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:20.708870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-781709f6-46ca-4343-8b3c-761466f8163b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090504 May 09 10:15:20.709469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1277/2556] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:20.806650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:20.815712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3eadecd-bb1a-4496-82fb-691931b65a8a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.192846 May 09 10:15:20.816308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1280/2557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:20 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:20.938122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:20.938652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:20.946561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.947137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:20.948013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:20.948524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.106050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:21.118619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-175a590b-e514-45ab-8d81-8826263f3944 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.184271 May 09 10:15:21.119226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1278/2558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:20 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:21.519951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:21.520717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:21.527998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:21.528498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.529427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:21.529912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.598139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:21.613713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:21.616686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:21.618824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f6eeca62-1e61-494e-8008-6e35e489c3e8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.102925 May 09 10:15:21.619849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1281/2559] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:21 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:21.727372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:21.728125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:21.735724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:21.736204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.737109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:21.737553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.805580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:21.814267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8bf4d8b-4346-48db-84e1-e7efe63962b8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090963 May 09 10:15:21.814949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1279/2560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:21.833300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:21.834078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:21.840707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:21.841221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.842728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:21.843253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:21.983989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:21.992727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f3f3515-86ae-4b09-a8b6-06615ab56fef tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.163259 May 09 10:15:21.993323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1282/2561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:21 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:22.136970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:22.137469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:22.144461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:22.144939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:22.145727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:22.146165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:22.305570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:22.315194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-308af2bf-e0cd-427f-958e-cb4efca0e0f5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.182177 May 09 10:15:22.315785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1280/2562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:22 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:22.647929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:22.648590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:22.655961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:22.656413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:22.657260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:22.657697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:22.731580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:22.741370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:22.743005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:22.744215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5d3d75a7-d649-48ef-92f8-e0982bb6f1c4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.100418 May 09 10:15:22.744842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1283/2563] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:22 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:22.832207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:22.832920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:22.839978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:22.840427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:22.841247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:22.841683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:22.906049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:22.914622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3ea0bdf-e520-4d71-97a1-909041fd9fe5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086396 May 09 10:15:22.915200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1281/2564] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:23.011382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:23.011899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:23.018765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.019278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.020158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.020717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.161993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:23.171536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-027e75b4-ed40-4a41-babc-2c0b95671dcd tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164293 May 09 10:15:23.172182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1284/2565] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:23 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:23.333252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:23.333867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:23.340627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.341104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.342040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.342473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.497362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:23.507115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a54aa77-93ac-466d-8d74-3a098819ff47 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.177586 May 09 10:15:23.507845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1282/2566] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:23 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:23.763719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:23.764370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:23.771635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.772088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.772954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.773396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.845002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:23.857208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:23.858704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:23.859912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ff81bf43-cef4-4b84-9bc9-c3c1b59b47e5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.100795 May 09 10:15:23.860480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1285/2567] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:23 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:23.932330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:23.933091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:23.940172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.940641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:23.941454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:23.941873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.007404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:24.016175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8f6eab6d-e7b4-466d-a693-494df3a7ecd4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087806 May 09 10:15:24.016653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1283/2568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:24.189443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:24.190413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:24.199843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:24.200549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.201461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:24.201942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.362762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:24.371274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fac1eb1-0517-4eb5-861e-6c1d40fb74af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.185827 May 09 10:15:24.371857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1286/2569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:24 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:24.525481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:24.526097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:24.532880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:24.533339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.534131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:24.534570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.720533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:24.730244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66d85de8-0529-40d5-93f2-a4db13a6c337 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.208645 May 09 10:15:24.730846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1284/2570] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:24 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:24.879160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:24.879860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:24.886840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:24.887283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.888066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:24.888494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:24.954708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:24.964242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:24.965855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:24.967198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8eff7dac-718a-470c-ae58-1828a5387e5b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.092266 May 09 10:15:24.967863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1287/2571] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:24 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:25.033603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:25.034211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:25.041251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.041708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.042495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.042937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.109296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:25.117885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-00248180-cb6f-49f0-8af9-86ffc501433f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088146 May 09 10:15:25.118472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1285/2572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:25.390100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:25.390924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:25.398326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.398777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.399564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.399999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.542536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:25.551662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-471e1e45-c476-4502-8ceb-1d5634ac4f89 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.165855 May 09 10:15:25.552277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1288/2573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:25 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:25.748512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:25.749062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:25.755783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.756260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.757080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.757516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.896238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:25.905122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a83c647d-f5ce-4024-855b-d6d38fd417a4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161081 May 09 10:15:25.905693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1286/2574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:25 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:25.987062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:25.987833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:25.994530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.994981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:25.995914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:25.996364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:26.065497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:26.074656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:26.076277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:26.077482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eea37e70-89b4-4ceb-9bda-6e9e7a5e775c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094593 May 09 10:15:26.078058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1289/2575] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:25 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:26.135292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:26.135926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:26.142950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:26.143460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:26.144352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:26.144884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:26.209661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:26.218474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-197acb11-ad02-4759-bc29-7185682850fe tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087056 May 09 10:15:26.219071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1287/2576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:26.575893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:26.577047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:26.588037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:26.588856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:26.590146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:26.590829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:26.733810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:26.742423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2e5db714-6f2b-454e-90b7-3419b8eed4ab tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.174118 May 09 10:15:26.743068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1290/2577] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:26 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:26.924958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:26.925611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:26.933935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:26.934300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:26.935158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:26.935780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:27.092323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:27.097544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:27.098395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:27.103091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2614042-14b8-4d0f-b03f-95ba8ea13ce5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.184383 May 09 10:15:27.103956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1288/2578] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:26 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:27.105675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:27.106342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:27.107268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:27.107807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:27.174871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:27.184197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:27.185808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:27.186971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e159ffe-a394-4561-acc3-99fcd488a179 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094604 May 09 10:15:27.187577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1291/2579] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:27 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:15:27.236196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:27.236880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:27.243778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:27.244242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:27.245076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:27.245519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:27.312051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:27.321874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0d2d1014-3857-4604-9dca-e5a64e4dae12 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089613 May 09 10:15:27.322535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1289/2580] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:27.760238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:27.760891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:27.767659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:27.768109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:27.768933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:27.769370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.123761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:28.124295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:28.131076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:28.131531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.132324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:28.132796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.165573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:28.174454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f36a388-d0dd-4be7-8f86-6849dc7548c3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.418111 May 09 10:15:28.175054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1292/2581] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:27 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:28.213300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:28.214058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:28.220535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:28.221412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.222275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:28.222783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.296027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:28.299126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:28.307674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:28.309221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:28.310428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b0b8543e-2071-411d-a86b-cf220aa9fc99 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.101120 May 09 10:15:28.311010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1293/2582] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:28 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:28.311177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58a2a2b2-c738-440e-9622-3e5fc44342a6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.191114 May 09 10:15:28.311934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1290/2583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:28 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:28.339500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:28.340105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:28.346784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:28.347230 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.348011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:28.348443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:28.412410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:28.426917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57154c04-aafe-406a-a407-269054538812 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090826 May 09 10:15:28.427963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1294/2584] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:29.192135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:29.192779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:29.201247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.201672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.202479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.202909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.329574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:29.332141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:29.336829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.337285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.338090 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.338536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.344843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:29.353576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-11ebb965-34aa-4dee-b866-f7b05ba077ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.165317 May 09 10:15:29.354293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1291/2585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:29 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:29.359161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:29.359884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:29.366198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.366725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.367575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.368069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.418577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:29.427697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:29.429293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:29.430487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e9555fad-5405-43ce-8ea9-189fe037a564 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.104952 May 09 10:15:29.431062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1295/2586] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:29 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:29.452404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:29.453212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:29.460094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.460595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.461402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:29.461832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:29.529277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:29.529888 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:29.539306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8235daa2-f024-4ef7-8377-66c94f8db385 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091587 May 09 10:15:29.540479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1296/2587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:29.557893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7c814092-90ff-4b04-850d-5b9a85ec5086 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.202270 May 09 10:15:29.559078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1292/2588] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:29 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:30.380140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:30.380771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:30.387863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.388437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.389639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.390081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.449230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:30.450034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:30.456957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.457411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.458185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.458617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.522318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:30.527789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:30.530921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-dbb32202-e759-4fec-91f8-29759420f6b5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154691 May 09 10:15:30.531923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1297/2589] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:30 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:30.537235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:30.538727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:30.539886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bcdd945a-2421-470e-861a-ea83dc289323 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094713 May 09 10:15:30.540754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1293/2590] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:30 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:30.556306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:30.556940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:30.563174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.563618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.564382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.564865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.584694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:30.585371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:30.591446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.591898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.592702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:30.593168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:30.630055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:30.642966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-30afc2a7-1c62-4c92-9585-d4d22f7567c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090431 May 09 10:15:30.643789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1298/2591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:30.740711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:30.748973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f919c64-a32e-4df2-843d-cfa0f124aa32 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.168246 May 09 10:15:30.749580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1294/2592] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:30 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:31.550694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:31.551374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:31.558353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.558791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.559564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.561374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:31.562053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:31.562229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.569156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.569607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.570416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.570854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.642121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:31.651199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:31.652811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:31.654132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-897a8032-2fe2-462a-b2a8-493dc06a4595 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.098514 May 09 10:15:31.654710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1295/2593] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:31 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:15:31.668481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:31.669144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:31.675831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.676294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.677354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.677852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.716401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:31.729645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f651b044-2416-4139-8f3c-8bb3948380b3 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.182482 May 09 10:15:31.730571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1299/2594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:31 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:31.750300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:31.759266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-61f49b74-aa07-41e1-99eb-cfefdc48cc22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095497 May 09 10:15:31.759855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1296/2595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:31.766451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:31.767223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:31.773650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.774068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.774855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:31.775288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:31.915760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:31.924077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c99fb1b3-2476-47a1-8955-aa4684ee4226 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.161531 May 09 10:15:31.924743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1300/2596] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:31 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:32.675502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:32.676107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:32.683057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.683522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.684304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.684774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.749481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:32.750495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:32.753589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:32.759877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.760536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.761643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.762145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.764856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:32.766819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:32.768085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4b426d1-956b-4a47-af3f-7f2c32f439e0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096691 May 09 10:15:32.768749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1297/2597] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:32 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:32.778521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:32.779485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:32.787088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.787820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.788921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.789534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.870642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:32.885321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-daf6b86d-dbad-464b-80ab-3d59cecbdb68 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.111115 May 09 10:15:32.886383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1298/2598] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:32.933045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:32.941661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:32.942272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:32.942882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b7ac981-40c1-4dac-8877-b54bc03ecbec tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.198120 May 09 10:15:32.943578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1301/2599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:32 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:32.948726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.949178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:32.949962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:32.950405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.084706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:33.093504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e890c1b1-11cd-4078-baa8-8745521670b3 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155771 May 09 10:15:33.094073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1299/2600] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:32 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:33.787589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:33.788190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:33.795181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:33.795630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.796482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:33.796956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.860407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:33.869665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:33.871196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:33.872521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f6444b45-81eb-4e87-95fe-43e9f7eb9140 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.088804 May 09 10:15:33.873146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1302/2601] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:33 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:33.909481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:33.910435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:33.916928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:33.917377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.918146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:33.918573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.961482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:33.962274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:33.969988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:33.970435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.971531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:33.971963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:33.986602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:33.995054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-090381fa-0c05-488a-9052-db3d8f72b32c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089530 May 09 10:15:33.995644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1300/2602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:34.110729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:34.114686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:34.115620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:34.123804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0e1f3996-3a90-423c-b41c-52f1dc0a9fa5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166714 May 09 10:15:34.124941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1303/2603] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:33 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:34.125095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:34.125783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:34.127097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:34.127850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:34.275534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:34.284588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-45ac5cf1-1028-4a08-92d5-6fb607eb23c1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.176473 May 09 10:15:34.285185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1301/2604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:34 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:34.891296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:34.892108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:34.898680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:34.899099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:34.899888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:34.900345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:34.964983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:34.974388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:34.975859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:34.977049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8d179e75-ec58-48c2-8b9f-f2a373df2570 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.089803 May 09 10:15:34.977613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1304/2605] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:34 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:35.012073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:35.012833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:35.020114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:35.020619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:35.021541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:35.022087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:35.093791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:35.102684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cdd3fc94-e4b6-4946-872b-227978d80bdc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094739 May 09 10:15:35.103283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1302/2606] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:35.148755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:35.149279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:35.156068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:35.156511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:35.157309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:35.157754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:35.302676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:35.303301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:35.309034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:35.309970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:35.310428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:35.311217 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:35.311652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:35.318993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac3fba2e-de69-450c-a17f-077e09efc97b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.174399 May 09 10:15:35.319589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1305/2607] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:35 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:35.446656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:35.458098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62ab735a-632d-49ef-a43a-c26666ee9aef tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159146 May 09 10:15:35.459138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1303/2608] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:35 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:35.995989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:35.996766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:36.003589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.004024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.004832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.005271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.073610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:36.082931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:36.084799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:36.085966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0c170f04-7adb-42ac-9d4b-b5500a6595a2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094237 May 09 10:15:36.086591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1306/2609] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:35 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:36.120179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:36.120889 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:36.127782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.128237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.129071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.129507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.195374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:36.204005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d06c5ee-e3f1-43b7-b02b-4e87c6049288 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087709 May 09 10:15:36.204593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1304/2610] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:36.336077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:36.336696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:36.343324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.343760 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.344558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.345024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.476883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:36.477535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:36.484486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.485359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.486163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:36.486637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:36.497204 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:36.506211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1a036d31-95ad-48aa-8d37-9e483e06a7ee tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.174005 May 09 10:15:36.506809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1307/2611] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:36 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:36.624545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:36.632979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10ec78ad-bdb6-46eb-a9fb-b210001dce53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160154 May 09 10:15:36.633561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1305/2612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:36 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:37.105620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:37.106280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:37.113726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.114176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.114974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.115386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.189027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:37.197969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:37.199465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:37.200694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5e161560-4bb2-4367-bdd4-52a4512d7156 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.099113 May 09 10:15:37.201293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1308/2613] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:37.221820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:37.222442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:37.229254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.229688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.230469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.230913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.294615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:37.303551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0bb28d9b-799c-4027-8cb9-312cc6d8630d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085933 May 09 10:15:37.304185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1306/2614] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:37.524104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:37.524628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:37.531353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.531810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.532604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.533062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.650624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:37.651340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:37.658718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.659376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.659925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:37.660390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:37.675930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:37.685020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-51e48f58-c2cd-461b-90da-2c0fd0248c4c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.164879 May 09 10:15:37.685583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1309/2615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:37 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:37.802763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:37.811441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3f70fb82-c8c4-4b46-af2e-23ec812debaa tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.164691 May 09 10:15:37.812033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1307/2616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:37 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:38.219762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:38.220412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:38.229194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.229645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.230458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.230894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.299607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:38.310766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:38.312710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:38.313985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-184f3465-ea76-42b3-9439-3b4a07d76ac3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.098792 May 09 10:15:38.314563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1310/2617] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:38 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:38.321952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:38.322670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:38.330189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.330668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.331476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.331937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.401554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:38.410516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1e4740f7-c175-4aaa-a929-6eef7fa560b1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093106 May 09 10:15:38.411420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1308/2618] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:38.703578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:38.704253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:38.711078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.711531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.712322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.712800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.829069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:38.829609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:38.835760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.836221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.837049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:38.837486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:38.861121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:38.877989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a26944ba-2c54-43b8-b6b0-0bcb77557695 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.178128 May 09 10:15:38.879225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1311/2619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:38 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:38.973873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:38.982712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d74e27c3-aa18-4cac-9ccd-214703998123 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157742 May 09 10:15:38.983271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1309/2620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:38 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:39.332576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:39.333228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:39.340150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:39.340599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:39.341516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:39.341931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:39.409978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:39.419266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:39.420791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:39.421954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04faeb32-cd66-4c25-9584-53fbd106323c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.093593 May 09 10:15:39.422554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1312/2621] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:39 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:39.430677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:39.431302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:39.438160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:39.438609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:39.439385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:39.439818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:39.504799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:39.514028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2f0b09be-2a0d-4a05-8d48-85da26e9ec4c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087238 May 09 10:15:39.514617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1310/2622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:39.903067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:39.903778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:39.910856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:39.911295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:39.912062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:39.912487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.001035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:40.001684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:40.008385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:40.008850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.009631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:40.010072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.064076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:40.082039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-56d6f92d-e089-4249-8999-636800ac16a5 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.182393 May 09 10:15:40.083199 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1313/2623] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:39 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:40.160717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:40.169218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d69b3874-0fb6-4e52-ad84-7ab38ddb8725 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.172786 May 09 10:15:40.169810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1311/2624] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:39 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:40.434233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:15:40.435160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:15:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:15:40.444228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:40.444893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:40.452011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:40.452463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.453342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:40.453815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.523306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:40.531187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:40.531799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:40.541162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:40.541404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:40.541546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:40.541658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.541658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:40.541832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6d7f72be-e56c-4dab-9672-6739faebbc00 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.104439 May 09 10:15:40.541919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:40.542016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1314/2625] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:40 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:40.605266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:40.613419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-907ac78d-b109-47b0-9914-b2f2f5e50154 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086282 May 09 10:15:40.613999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1312/2626] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:41.107975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:41.108602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:41.115403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.115831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.116626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.117079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.190626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:41.191629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:41.202322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.203149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.204500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.205349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.261531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:41.270212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8b54c956-2073-4544-be10-3ae04406da72 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.166310 May 09 10:15:41.270795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1315/2627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:41 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:41.359163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:41.368183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7422829b-5774-44a0-92af-0bea3f420431 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.184765 May 09 10:15:41.368814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1313/2628] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:41 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:41.562056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:41.562800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:41.569862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.570335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.571160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.571597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.630885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:41.631626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:41.636047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:41.637853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.638313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.639098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:41.639538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:41.645843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:41.647786 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:41.649160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7591e46d-95ef-4e18-981c-56ba3b532f3e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091321 May 09 10:15:41.649867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1316/2629] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:41 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:41.706226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:41.714605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5427aeff-8a5a-471c-a82e-cb88d0691a2a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087640 May 09 10:15:41.715186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1314/2630] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:42.287549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:42.288222 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:42.294584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.295051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.295794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.296226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.386894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:42.388154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:42.394134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.394603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.395397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.395803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.448332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:42.459503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0972948c-137b-4436-8b50-c98487881023 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.175703 May 09 10:15:42.460473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1317/2631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:42 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:42.626423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:42.634745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac1ce067-b40c-4511-b9ef-f05cf4d95782 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.251786 May 09 10:15:42.635437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1315/2632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:42 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:42.667758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:42.668549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:42.675531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.675987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.676860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.677276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.734188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:42.734428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:42.740404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.740896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.741666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:42.742095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:42.746053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:42.757542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:42.759481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:42.760696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3efb84ce-e869-4699-9b3b-7258ca3b1403 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.097011 May 09 10:15:42.761260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1318/2633] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:42 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:42.810995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:42.819165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9dbfe5f4-d1b9-45d4-907c-aff87329596c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089679 May 09 10:15:42.819732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1316/2634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:43.479349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:43.479959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:43.486570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.486988 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.487783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.488217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.626985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:43.635591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac1961d7-7377-4bc7-98be-a5488e5a6821 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.160133 May 09 10:15:43.636185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1319/2635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:43 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:43.654597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:43.655384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:43.664083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.664771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.665901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.666348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.779477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:43.780205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:43.791887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.792828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.793798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.794411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.815890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:43.830211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9ab1c8e-b8d0-4dab-81aa-715e8f7d1f67 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.180711 May 09 10:15:43.831765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1317/2636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:43 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:43.840248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:43.841351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:43.851332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.851802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.852790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:43.853226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:43.884340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:43.893845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:43.895629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:43.897215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2b6809b-0a88-4ab4-adb3-d168da6c36a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.121737 May 09 10:15:43.898042 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1320/2637] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:43 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:15:43.918883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:43.927722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4bfcde01-1060-42e3-be91-01c925acd7b5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094402 May 09 10:15:43.928328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1318/2638] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:44.653743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:44.654251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:44.661015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:44.661490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:44.662273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:44.662710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:44.796075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:44.804266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fbfbfc55-aa88-4768-8a99-9689f351c576 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154891 May 09 10:15:44.804889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1321/2639] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:44 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:44.848955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:44.849632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:44.856876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:44.857319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:44.858110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:44.858544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:44.915828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:44.916345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:44.923519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:44.923965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:44.924823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:44.925251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:44.994855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:45.002879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:45.003524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:45.005326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:45.006469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bd34170a-3025-409a-a140-ea7800fb4261 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.094916 May 09 10:15:45.007038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1322/2640] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:44 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:15:45.011676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:45.012341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:45.014086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e928e47-4224-4347-a87d-f0ffd13926fb tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.169152 May 09 10:15:45.014996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1319/2641] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:44 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:45.023437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:45.023874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:45.024650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:45.025506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:45.062414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:15:45.062663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:15:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:15:45.095413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:45.104051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-819d5ac6-08f9-4a4c-8f08-bde817d3c72c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096006 May 09 10:15:45.104631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1323/2642] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:45.826537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:45.827156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:45.834205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:45.834664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:45.835448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:45.835892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:45.968199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:45.976917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70c06a40-594d-45cc-bf3a-87d15b71762c tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154282 May 09 10:15:45.979472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1320/2643] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:45 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:46.028878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:46.029477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:46.032004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:46.032645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:46.036130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:46.036532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:46.037344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:46.037773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:46.039812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:46.040302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:46.041098 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:46.041541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:46.105039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:46.116481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:46.119318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:46.121390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-062d70c4-fa4f-4d73-adc2-b1ebfbb348ee tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.096327 May 09 10:15:46.122394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1324/2644] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:46 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:46.130145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:46.130759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:46.137417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:46.137966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:46.138722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:46.139151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:46.191270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:46.199587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4e2345a-4e8a-48e1-b13e-f36d363acdb4 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.171831 May 09 10:15:46.200205 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1321/2645] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:46 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:46.203995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:46.212550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef43f014-6a41-40a3-af8d-bbc81ed6269d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086901 May 09 10:15:46.213176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1325/2646] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:46.994692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:46.995368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:47.002420 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.002877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.003652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.005150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.135100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:47.140174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:47.140779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:47.144054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0c499e90-27df-4a27-84eb-200ad9936f9d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153433 May 09 10:15:47.144689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1322/2647] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:46 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:47.147908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.148359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.149179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.149616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.214743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:47.217110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:47.217732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:47.224037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:47.225337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.225674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:47.225850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.226574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.226823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-306031d8-b01c-45d8-89f3-60dc5415ab41 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.090575 May 09 10:15:47.226991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.227385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1326/2648] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:47 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:15:47.231753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:47.232350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:47.238275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.238722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.239481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:47.239914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:47.300111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:47.308160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-042fc784-4aa2-49c5-91b6-974d877f7d26 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.079845 May 09 10:15:47.309071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1327/2649] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:47.363138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:47.372376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7c64ed7-209f-4baf-8d30-f941da18a1cf tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158925 May 09 10:15:47.373005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1323/2650] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:47 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:48.161823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:48.162598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:48.169421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.169874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.170649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.171084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.247537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:48.248310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:48.255391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.255846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.256702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.257135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.316519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:48.321938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:48.325237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7cc295af-b391-4c74-815d-c006feed4a7f tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.167298 May 09 10:15:48.326017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1328/2651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:48 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:48.330454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:48.330869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:48.331083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:48.332374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:48.333973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cf61bb24-22b2-4659-a9be-7a9f74d6968e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091314 May 09 10:15:48.336845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1324/2652] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:48 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:48.337227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.337678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.338473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.338897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.390249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:48.391020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:48.397189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.397639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.398421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:48.398890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:48.400874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:48.408908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8237d977-c1f6-46a1-a4ac-01fc7f132c7a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.081916 May 09 10:15:48.409473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1329/2653] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:48.527326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:48.536109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2931f4d6-1064-4ed6-bb32-d29381611ea6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.149938 May 09 10:15:48.536949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1325/2654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:48 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:49.342728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:49.343411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:49.350508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.350950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.351573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:49.352085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.352085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.352291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:49.359317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.359767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.360529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.361003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.423685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:49.432599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:49.434187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:49.435364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e2f7c3ca-dce0-4931-b81b-ba3233b761bf tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.087638 May 09 10:15:49.435894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1326/2655] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:49 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:49.440303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:49.440937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:49.447189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.447673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.448421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.448915 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.486856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:49.494886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-da774077-aca2-4048-b045-d248fa47a826 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.156115 May 09 10:15:49.495460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1330/2656] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:49 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:49.513718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:49.521797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20f9e805-ad4c-4c9b-b212-37c7e325aa7c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084969 May 09 10:15:49.522356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1327/2657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:49.553706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:49.554306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:49.560657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.561753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.561884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:49.562301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:49.699055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:49.707245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95b14c5a-dd35-469b-9292-980547a42c53 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.157501 May 09 10:15:49.707824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1331/2658] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:49 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:50.453950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:50.454538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:50.461442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.461896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.462667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.463104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.511930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:50.512625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:50.519344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.519863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.520784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.521212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.528862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:50.538793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:50.540321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:50.541540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fff3c7b2-436a-4f9e-b38e-b4ec21ad14a8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091572 May 09 10:15:50.542291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1328/2659] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:50 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:50.547300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:50.547912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:50.555353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.555816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.556600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.557227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.620787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:50.629178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7213c9dc-31c7-49aa-b7ac-391a3cdcc147 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085967 May 09 10:15:50.629795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1329/2660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:50.650462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:50.658483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4303d08a-631d-4887-a56d-81706c4d5774 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.150446 May 09 10:15:50.659067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1332/2661] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:50 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:50.725326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:50.725845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:50.732478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.732981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.733754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:50.734191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:50.866340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:50.874720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-81bbffaa-00c0-4587-9ac4-22f60b26288e tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153732 May 09 10:15:50.875294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1330/2662] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:50 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:51.559769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:51.561202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:51.567349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.567804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.568585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.569048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.634784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:51.644450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:51.646004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:51.646861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:51.647384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db1c9b4e-54f3-44ee-ae0d-dc4e140b7e07 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.091510 May 09 10:15:51.647506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:51.649216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1333/2663] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:51 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:51.654931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.655393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.656173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.656604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.675882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:51.676498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:51.683699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.684203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.685020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.685477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.726275 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:51.734845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25386b70-1e50-4891-b13a-d6f2ec3b40d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091736 May 09 10:15:51.735442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1331/2664] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:51.821496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:51.830577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-96b1a0c0-482d-4de0-8933-fa59e6a28746 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.158295 May 09 10:15:51.830812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1334/2665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:51 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:51.892128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:51.892756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:51.899350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.899798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.900564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:51.901028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:51.937700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:15:51.937982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:15:52.032510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:52.040467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1fa70e7-eaea-44bb-8b3e-2ff49574b0b6 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152260 May 09 10:15:52.041027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1332/2666] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:51 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:52.666383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:52.667007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:52.673768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:52.674213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:52.674974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:52.675400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:52.738090 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:52.747105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:52.748620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:52.749794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a998e104-6e17-4631-8c83-cbf14fb3774b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.087397 May 09 10:15:52.750349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1335/2667] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:52 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:52.752111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:52.752697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:52.759527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:52.759980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:52.760765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:52.761198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:52.825052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:52.833591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4d9fe96e-33ac-4ec8-84c8-4d3148ea9a4a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085491 May 09 10:15:52.834152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1333/2668] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:15:52.847860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:52.848476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:52.855084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:52.855505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:52.856326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:52.856798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:52.989529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:52.997994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2bbdd1e0-59fe-45f0-b66f-dac04edc473b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154351 May 09 10:15:52.998566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1336/2669] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:52 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:53.058957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:53.059548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:53.066223 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:53.066710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:53.067482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:53.067922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:53.199573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:53.207686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3d401d4f-9d7c-4e94-b94b-5e97c9b2f2a1 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152674 May 09 10:15:53.208263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1334/2670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:53 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:53.768499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:53.769168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:53.775603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:53.776047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:53.776831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:53.777259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:53.838695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:53.847942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:53.849495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:53.850614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cb8524f5-346e-42d7-9bb3-3f797ac2b9f9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.086100 May 09 10:15:53.850938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:53.851563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:53.857067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1337/2671] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:53 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:53.858795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:53.859551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:53.860456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:53.861003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:53.925982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:53.934743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9107808c-962d-485a-962b-0f016bfeb30d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087615 May 09 10:15:53.935316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1335/2672] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:54.015575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:54.016182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:54.022567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.023010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.023770 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.024200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.155922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:54.166082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8efc0f10-a001-4e82-83dc-858aa0a2df94 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154817 May 09 10:15:54.166627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1338/2673] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:54 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:54.224701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:54.225336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:54.232072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.232531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.233343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.233775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.386615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:54.395323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-15c0d025-4a1e-4f8f-b829-97b8827ceff9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.174855 May 09 10:15:54.395909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1336/2674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:54 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:54.870882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:54.871677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:54.878601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.879061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.879835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.880271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.944700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:54.951684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:54.952261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:54.953442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:54.954965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:54.956105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-838f174f-b1bc-4dbf-b1e9-86782571750a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.090242 May 09 10:15:54.956689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1339/2675] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:54 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:54.959245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.959689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:54.960477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:54.960980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:55.030590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:55.038943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e95d427-435b-4c38-b2bf-696d36911e2c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091004 May 09 10:15:55.039535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1337/2676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:55.183922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:55.184497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:55.191327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:55.191784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:55.192616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:55.193115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:55.327084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:55.335145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca7198b9-a91a-40e2-96bc-e286fa44707b tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155452 May 09 10:15:55.335730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1340/2677] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:55 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:55.412298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:55.412934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:55.419696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:55.420146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:55.420962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:55.421388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:55.552240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:55.560711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-508c0323-cb33-416a-9658-197abe619d91 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152239 May 09 10:15:55.561469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1338/2678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:55 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:55.975720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:55.976409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:55.983397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:55.983837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:55.984603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:55.985091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.047366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:56.055491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:56.056032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:56.056163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:56.057534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:56.058668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db30eaa4-d58b-4a74-b25d-2740bc8a29c9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.086970 May 09 10:15:56.059192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1341/2679] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:55 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:56.062942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:56.063386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.064155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:56.064583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.125489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:56.133591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-532a65be-a6a3-4618-a951-090dfe19c3ef tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082034 May 09 10:15:56.134134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1339/2680] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:56.352755 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:56.353365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:56.359883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:56.360346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.361134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:56.361560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.492979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:56.501328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f30a12b-01d9-4143-a9e2-0d8d6f54c504 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152477 May 09 10:15:56.501909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1342/2681] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:56 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:56.578237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:56.578854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:56.585458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:56.585909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.586687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:56.587149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:56.725157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:56.733282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-089d10fa-c34c-4562-b8c2-ff2379a3aee5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.158979 May 09 10:15:56.733855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1340/2682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:56 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:57.077554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:57.078183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:57.084995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.085444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.086205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.086634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.150071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:57.150733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:57.151500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:57.158239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.158694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.159180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:57.159472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.159912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.160709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:57.161894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e6ad731-a459-4c09-9819-f3fa9d1a12a3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.088293 May 09 10:15:57.162455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1343/2683] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:57 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:57.221853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:57.230065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d396faa1-9e6f-4b30-9dd7-6f86af9e457f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083191 May 09 10:15:57.230635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1341/2684] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:57.519023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:57.519541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:57.526249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.526693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.527461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.527952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.661701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:57.670479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c898aca2-6ced-4a64-a7b8-77597f0220af tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.155493 May 09 10:15:57.671056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1344/2685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:57 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:57.751115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:57.751724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:57.758039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.758490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.759251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:57.759692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:57.891756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:57.900695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-76aaa620-c9f3-41b1-8fea-dbc3dae1925c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153405 May 09 10:15:57.901295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1342/2686] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:57 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:58.180531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:58.181180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:58.188045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.188490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.189291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.189721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.246707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:58.247369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:58.254186 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.254594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:58.254768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.255442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.255880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.264609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:58.266163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:58.267275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-77c2c988-36c1-4a9c-848a-879f1478b043 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.090815 May 09 10:15:58.267839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1345/2687] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:58 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:58.320348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:58.328695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d21c38e7-f61b-44b3-9440-737c080bf090 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085978 May 09 10:15:58.329423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1343/2688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:58.687564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:58.688088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:58.694805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.695247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.696006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.696440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.827951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:58.836330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3de429c6-c7d9-43a1-a663-92fe1cfff658 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152923 May 09 10:15:58.837002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1346/2689] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:58 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:58.917557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:58.918138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:58.924848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.925294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:58.926050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:58.926477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.058759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:59.067111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-06cdcd1c-adba-4b67-92d2-94f26b2efb00 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.153417 May 09 10:15:59.067688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1344/2690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:58 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:59.286127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:59.286709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:59.293723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:59.294170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.294927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:59.295357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.346020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:59.346742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:59.353824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:59.354412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.355267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:59.355712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.360235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:59.369040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:59.370537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:59.371739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-864d3112-7f2a-4d30-985f-2237665bd19b tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.089733 May 09 10:15:59.372385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1347/2691] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:15:59 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:15:59.419075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:15:59.426827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9e5c1b3-7835-4d7e-bfa3-3b2a2e6009d8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085135 May 09 10:15:59.427429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1345/2692] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:15:59.854457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:15:59.854984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:15:59.861825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:59.862280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.863092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:15:59.863517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:15:59.994605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:00.002971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0a87e962-1be8-4b34-8074-6902e9c1fb27 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152486 May 09 10:16:00.003525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1348/2693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:15:59 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:00.088187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:00.089228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:00.096487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:00.096962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:00.097735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:00.098163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:00.199434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:16:00.199699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:16:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:16:00.234779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:00.243023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ebef4da2-c46e-41cc-a91b-cb7843d58536 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.160885 May 09 10:16:00.243630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1346/2694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:00 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:00.389885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:00.390554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:00.397432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:00.397878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:00.398647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:00.399075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:00.445488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:00.446136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:00.453870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:00.454322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:00.455113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:00.455552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:00.471365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:00.480051 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:00.481658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:00.482846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ac689389-b095-49b1-973e-02261783948f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.097187 May 09 10:16:00.483630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1349/2695] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:00 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:00.519646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:00.531442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4b252d3e-be5d-47a9-a015-6e8030a19911 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.091321 May 09 10:16:00.532219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1347/2696] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:01.022511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:01.023435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:01.031206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.031650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.032416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.032877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.162000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:01.171640 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6dbad3d1-7e69-43a3-a7bd-02b8b2904117 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154960 May 09 10:16:01.172229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1350/2697] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:01 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:01.260557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:01.261253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:01.268188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.268635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.269447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.269879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.404077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:01.412492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-18212abb-a5a4-41ab-9666-0ac497cdfc1a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155940 May 09 10:16:01.413159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1348/2698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:01 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:01.501291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:01.501922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:01.508681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.509145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.509911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.510343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.550525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:01.551107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:01.557975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.558419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.559242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:01.559673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:01.574201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:01.583262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:01.584773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:01.585933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-57aa1d75-6742-40fa-95d2-fa6a9e1b35d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.088614 May 09 10:16:01.586515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1351/2699] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:01 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:01.626443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:01.634539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68593db9-a728-4b81-aad8-ed5ae3d5bae0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087882 May 09 10:16:01.635112 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1349/2700] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:02.189032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:02.189644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:02.196171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.196617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.197408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.197844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.337801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:02.346795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ad522cd4-1cdf-4676-b179-ca5512e367c8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.161722 May 09 10:16:02.347372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1352/2701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:02 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:02.430072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:02.430711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:02.437534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.437991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.438884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.439327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.573800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:02.581919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb23c195-22ea-496f-839f-92c9dfb62fc5 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.155678 May 09 10:16:02.583478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1350/2702] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:02 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:02.604840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:02.605478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:02.611899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.612348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.613153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.613591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.651231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:02.651954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:02.659124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.659124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.659695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:02.660127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:02.676424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:02.685777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:02.687529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:02.688714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7a05ba4-0a2a-4e66-bd07-41b1e5eb794f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.087890 May 09 10:16:02.700074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1353/2703] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:02 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:02.723335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:02.731992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70e2b86e-0a12-4632-bc6d-f200f64f05fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084541 May 09 10:16:02.732767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1351/2704] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:16:03.364228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:03.364860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:03.371818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.372263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.373070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.373495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.504103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:03.513201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-362f8eba-2546-4519-b1b4-f9046a96b320 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152820 May 09 10:16:03.513756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1354/2705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:03 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:03.600237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:03.601143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:03.608273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.608750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.609514 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.609943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.707324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:03.707957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:03.714705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.715247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.716058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.716492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.746314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:03.755210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a62c455-82c7-4d7b-bb3e-9b7eeb5ae872 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.159627 May 09 10:16:03.755862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1352/2706] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:03 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:03.760512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:03.761220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:03.767421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.767961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.768829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:03.769257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:03.784991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:03.793925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:03.795597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:03.796996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b17f6566-a3c8-4000-95b5-2269e9bfae39 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.093645 May 09 10:16:03.797593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1355/2707] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:03 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:03.832554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:03.841320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09b621a3-555b-4c52-9ffb-1fc689fceb3a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084314 May 09 10:16:03.841927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1353/2708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:04.530370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:04.530979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:04.537731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.538185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.538969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.539407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.669771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:04.677772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2d091de-03de-4e7d-bcaa-a6412bf0ac3d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.151388 May 09 10:16:04.678340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1356/2709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:04 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:04.773047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:04.773628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:04.780522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.780999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.781762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.782192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.815517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:04.816172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:04.822780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.823233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.824012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.824464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.886835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:04.895406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:04.896949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:04.898084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a37d922b-cfe1-45b8-8f89-6232298233b5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.086513 May 09 10:16:04.898943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1357/2710] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:04 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:04.903360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:04.904068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:04.909812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.910256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.911014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:04.911442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:04.911700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:04.919578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-906af8c1-c612-4a9b-91a0-33920ebd8d3a tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.150515 May 09 10:16:04.920140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1354/2711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:04 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:04.971294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:04.979345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ed0e2e9-621a-45c1-9011-255a3764f7bd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.079409 May 09 10:16:04.979939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1358/2712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:05.694641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:05.695284 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:05.701992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:05.702439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:05.703204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:05.703639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:05.834683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:05.843093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8941d876-dc19-44ca-8615-f2d490df1013 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.152364 May 09 10:16:05.843661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1355/2713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:05 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:05.916429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:05.917209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:05.924395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:05.924880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:05.925678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:05.926138 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:05.936445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:05.937104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:05.943500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:05.944116 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:05.944933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:05.945370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:05.993637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:06.002456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:06.003933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:06.005187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ea42d971-66b2-4bf6-ba2e-40490927f165 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.092875 May 09 10:16:06.005784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1359/2714] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:05 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:06.010252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:06.010853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:06.018102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:06.018562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:06.019321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:06.019751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:06.077379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:06.080296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:06.085438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2984e309-db55-4f41-a44b-1c710827e9f9 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.152873 May 09 10:16:06.086089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1356/2715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:05 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:06.088393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00d36eb1-6435-47f1-94bf-fe85d4d79fc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.081624 May 09 10:16:06.088976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1360/2716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:06.861059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:06.861729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:06.868440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:06.868931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:06.869700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:06.870109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.002469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:07.011121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-532a5fe3-6d4e-4c89-8fb4-d48b23a0e59d tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.153968 May 09 10:16:07.011695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1357/2717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:06 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:07.023445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:07.024053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:07.030809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:07.031258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.032022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:07.032458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.095677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:07.105503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:07.105767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:07.106378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:07.108072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:07.109320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-03aab62f-4dcf-464c-9cb1-aa48d8777fae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.089799 May 09 10:16:07.109860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1361/2718] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:07 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:07.112736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:07.113221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.113996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:07.114291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:07.114569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.114892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:07.121381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:07.121866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.122670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:07.123104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:07.184017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:07.192017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2628bfe7-4302-49ec-af45-72206802f816 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.081141 May 09 10:16:07.192572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1362/2719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:07 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:07.243210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:07.251708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9ecc578a-169c-416c-994a-bd4069e1ed84 tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.149985 May 09 10:16:07.252349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1358/2720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:07 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:08.027652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:08.028227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] [instance: ba59db3d-90cd-4f89-9b7a-31e36bab75eb] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:08.034958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.035405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.036164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.036593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.127542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:08.128163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:08.135027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.135478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.136249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.136803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.169645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cba3e3a904ca41b78e518699f88e315e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c46939bf6f40f19dac93cf5d494ab1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:08.178108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-17788891-7104-411d-9720-a530515133d8 tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb" status: 200 len: 1599 microversion: 2.1 time: 0.154397 May 09 10:16:08.178702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1363/2721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:08 2022] GET /compute/v2.1/servers/ba59db3d-90cd-4f89-9b7a-31e36bab75eb => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:08.194345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78ae564a-596c-44db-aa09-d020e1f36d7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] Calling method '.version_select at 0x7fa45efb98b0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:08.198135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:08.207197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:08.208726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:08.209914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6baafaac-f202-4b50-a96a-b1db2862f29d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.086344 May 09 10:16:08.210438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1359/2722] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:08 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:08.215581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:08.216248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:08.223279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.223712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.224484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.225018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.228983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78ae564a-596c-44db-aa09-d020e1f36d7a tempest-TestMinimumBasicScenario-875371807 tempest-TestMinimumBasicScenario-875371807-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-713787344" status: 202 len: 0 microversion: 2.1 time: 0.038285 May 09 10:16:08.229724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1364/2723] 10.222.0.26 () {58 vars in 1268 bytes} [Mon May 9 10:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-713787344 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 10:16:08.269408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:08.270227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] [instance: b7944fa2-ab61-4f7b-b2b1-799f6cd80268] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:08.277882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.278223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.279811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:08.280629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:08.291360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:08.301356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27d3ee3b-9f37-41c4-a9ea-61a3fb409e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089751 May 09 10:16:08.302373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1360/2724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:08.435561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a673de26884004bc852ef76b18aa06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '084ec4bab56b4c1d823158e34705bbf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:08.445883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-71eeda01-f1d9-4f29-a565-451ec15d5e4c tempest-VolumesSnapshotTestJSON-1017941071 tempest-VolumesSnapshotTestJSON-1017941071-project] 10.222.0.26 "GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268" status: 200 len: 1560 microversion: 2.1 time: 0.180240 May 09 10:16:08.445994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1365/2725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:08 2022] GET /compute/v2.1/servers/b7944fa2-ab61-4f7b-b2b1-799f6cd80268 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:09.233085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:09.233695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:09.240314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.241300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.242252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.242858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.295119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:09.296725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:09.304499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.305287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.306294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.306721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.313394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:09.322807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:09.324630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:09.326009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ef1a3228-08b7-4f56-b47f-36d6ecc6cbe9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 200 len: 1444 microversion: 2.20 time: 0.097059 May 09 10:16:09.326570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1361/2726] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:09 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:09.334468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:16:09.335746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:09.336533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:09.344598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.345094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.346181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.346610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.412047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:09.420980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-954b20ec-18a4-4007-8289-f816dd6e69c7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090362 May 09 10:16:09.422001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1362/2727] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:09.427162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-465ab81a-e494-40f5-9550-64d0f07cb120 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '.version_select at 0x7fa45ec04b80>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:09.438020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cc52c504-4eb0-499d-a5c3-e34faf95d0d2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 204 len: 0 microversion: 2.1 time: 0.145326 May 09 10:16:09.438887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1366/2728] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:16:09 2022] DELETE /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 10:16:09.447437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:09.448180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:09.452850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-465ab81a-e494-40f5-9550-64d0f07cb120 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941138886" status: 204 len: 0 microversion: 2.20 time: 0.029558 May 09 10:16:09.453699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1363/2729] 10.222.0.26 () {60 vars in 1258 bytes} [Mon May 9 10:16:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941138886 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 10:16:09.458128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.458638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.459432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:09.459974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:09.675491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:09.683899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a4d459cb-cbb6-460b-8e80-45b96f959798 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.240951 May 09 10:16:09.684849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1367/2730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:16:10.321707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58041e98-1efa-4421-ba90-cfa23804dd8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'create', calling method: .version_select at 0x7fa467ea8670>, body: {"keypair": {"name": "tempest-keypair-437056667"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:16:10.344330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-58041e98-1efa-4421-ba90-cfa23804dd8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:16:10.351100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-58041e98-1efa-4421-ba90-cfa23804dd8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for user 76dc34045544496ab030864c5a0ffbff and project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:16:10.447144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-58041e98-1efa-4421-ba90-cfa23804dd8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:16:10.451576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-58041e98-1efa-4421-ba90-cfa23804dd8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for user 76dc34045544496ab030864c5a0ffbff and project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:16:10.451682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:10.452254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:10.468519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58041e98-1efa-4421-ba90-cfa23804dd8f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.149542 May 09 10:16:10.468519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1364/2731] 10.222.0.26 () {62 vars in 1198 bytes} [Mon May 9 10:16:10 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 09 10:16:10.472966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:10.473870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:10.474313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:10.474744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:10.551754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:10.570625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b98a383c-58fa-487f-a263-e3547a79b2c6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.135304 May 09 10:16:10.571403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1368/2732] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:16:10.700766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:10.701854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:10.708059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:10.708871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:10.709884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:10.710545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:10.862409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:10.871118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6cababaa-9c57-44d2-b97d-53387db37a38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174232 May 09 10:16:10.871686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1365/2733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:11.589762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:11.591566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:11.600267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:11.600966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:11.607402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:11.608265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:11.887970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:11.888534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:11.895529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:11.895967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:11.896852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:11.897395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:11.946452 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:11.959198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5b48088-a44b-4fce-9e80-5e2a6f0455a7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.374852 May 09 10:16:11.962986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1369/2734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:12.143421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:12.153044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c26d92f6-e81c-42d8-a932-e3bde990bd8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.269248 May 09 10:16:12.154006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1366/2735] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:12.214197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-334280909", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5d2e451-c229-4fa8-9496-a76796ccc192"}], "security_groups": [{"name": "tempest-securitygroup--494611899"}], "key_name": "tempest-keypair-437056667", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:16:12.333641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] validate_networks() for [('a5d2e451-c229-4fa8-9496-a76796ccc192', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:16:12.798093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:16:12.798712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:16:12.799343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:16:12.799851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:16:12.800251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:16:12.810838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:12.813649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:12.814520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:12.814995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:12.833307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:16:12.838180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Getting quotas for user 76dc34045544496ab030864c5a0ffbff and project 8c91ae2e41a9487a9ae5fd4bf1b6d4f8. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:16:12.850405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:16:12.852738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:16:12.901942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4d15c07e-6482-4fa0-a327-eaad5bc49f77 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.692132 May 09 10:16:12.902791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1370/2736] 10.222.0.26 () {62 vars in 1187 bytes} [Mon May 9 10:16:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 09 10:16:12.913393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b8208ef8-92c8-4985-b6a0-a81d393bc753 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:12.913988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b8208ef8-92c8-4985-b6a0-a81d393bc753 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:12.971617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8208ef8-92c8-4985-b6a0-a81d393bc753 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:12.979272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8208ef8-92c8-4985-b6a0-a81d393bc753 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:12.980602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:12.980823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b8208ef8-92c8-4985-b6a0-a81d393bc753 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:12.981357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:12.981917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b8208ef8-92c8-4985-b6a0-a81d393bc753 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1280 microversion: 2.20 time: 0.072874 May 09 10:16:12.982677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1367/2737] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:12 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:12.987963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:12.988488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:12.989421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:12.989802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:13.056684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:13.065276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-913aee36-637a-4717-bab8-4054c5bf907c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089830 May 09 10:16:13.065859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1371/2738] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:13.171619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:13.172561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:13.179439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:13.180079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:13.187257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:13.187711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:13.327702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:13.338282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e9db3111-28e1-44fa-a541-8548f5c1e71d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.171046 May 09 10:16:13.339104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1368/2739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:14.000283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:14.000949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:14.008008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:14.008554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:14.009368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:14.009795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:14.076530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:14.081980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:14.083364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:14.087112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:14.088825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:14.090146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aeb4ee2b-1d00-4e99-a73a-8aa5c74330d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1340 microversion: 2.20 time: 0.093816 May 09 10:16:14.091161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1372/2740] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:13 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:14.092424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:14.092985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:14.093838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:14.094369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:14.164643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:14.173155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-123609de-b3c5-43d4-a2e5-51c1b7b15e90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095002 May 09 10:16:14.173864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1369/2741] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:14.355575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:14.356187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:14.362430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:14.362894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:14.363662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:14.364107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:14.503341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:14.512118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-867468ee-a564-468d-9f7c-8982cb819a86 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160415 May 09 10:16:14.512697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1373/2742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:15.109608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:15.110196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:15.117072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.117526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.118303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.118740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.190593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:15.191186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:15.198284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.198751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.199548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.199986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.262593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:15.270506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4568c346-6330-4fe2-ba9d-bc272f45e4f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083964 May 09 10:16:15.271096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1374/2743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:15.331640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:15.341566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:15.343602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:15.344856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-97e086e5-d3db-4bae-b0f8-84917da60a45 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.239278 May 09 10:16:15.346028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1370/2744] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:15 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:15.529600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:15.530536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:15.536651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.537124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.537935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.538351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.580352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-90ce53a9-d18e-478d-b0e8-61330cd3ac0c req-880dfb0e-02a2-4611-aaaf-2ce8f4f4bac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:16:15.592934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-90ce53a9-d18e-478d-b0e8-61330cd3ac0c req-880dfb0e-02a2-4611-aaaf-2ce8f4f4bac9 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:15.598989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-90ce53a9-d18e-478d-b0e8-61330cd3ac0c req-880dfb0e-02a2-4611-aaaf-2ce8f4f4bac9 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:15.613321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-90ce53a9-d18e-478d-b0e8-61330cd3ac0c req-880dfb0e-02a2-4611-aaaf-2ce8f4f4bac9 service nova] Creating event network-changed:001daf04-3f69-4af0-b1cf-e0ed36819de0 for instance 0e923da8-ef54-4364-a345-eb053850f0e6 on hv-cinder-84108 May 09 10:16:15.620138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-90ce53a9-d18e-478d-b0e8-61330cd3ac0c req-880dfb0e-02a2-4611-aaaf-2ce8f4f4bac9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048995 May 09 10:16:15.621120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1371/2745] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:16:15.705614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:15.714077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2a27e6c-18c4-4bd4-8318-89f2f49adc69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.188459 May 09 10:16:15.714712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1375/2746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:16.293122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:16.293845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:16.300208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:16.300652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:16.301435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:16.301899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:16.364224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:16.364888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:16.365061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:16.371791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:16.372241 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:16.373049 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:16.373204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d5442d63-405b-4f53-b716-83b5b68085b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087711 May 09 10:16:16.373479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:16.375884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1372/2747] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:16.506528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:16.514686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:16.516169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:16.517303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-74911d09-cb1e-48ee-ae48-088e271cacd4 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.157075 May 09 10:16:16.517862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1376/2748] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:16 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:16.732193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:16.732827 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:16.739597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:16.740333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:16.741332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:16.741859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:16.885981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:16.899942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44279b81-8095-4236-9aa5-f48b330b3188 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.171347 May 09 10:16:16.901024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1373/2749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:17.390408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:17.391016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:17.398014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:17.398463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:17.399239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:17.399674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:17.466039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:17.474733 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00773079-980f-4410-834f-3128bb49f7c0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088338 May 09 10:16:17.475353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1377/2750] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:17.536007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:17.537174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:17.544319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:17.544868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:17.545673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:17.546139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:17.680104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:17.688620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:17.690134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:17.691274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f3d1cafa-5105-4bf4-9290-8d5165b98821 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.159241 May 09 10:16:17.691814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1374/2751] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:17 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:17.917724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:17.918332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:17.924990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:17.925439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:17.926169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:17.926625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:18.056251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:18.065059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e376e3de-f5c5-4b86-8287-8eaa416177ed tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151196 May 09 10:16:18.065656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1378/2752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:18.492954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:18.493653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:18.500384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:18.500934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:18.501851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:18.502298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:18.584438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:18.592920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7f55cf86-81a5-4326-a4bc-2a0592a2bbfa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.104287 May 09 10:16:18.593506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1375/2753] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:18 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:18.709830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:18.710455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:18.717336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:18.717829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:18.718563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:18.718998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:18.848542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:18.856620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:18.858135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:18.859247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9d898fd-f56d-48a3-8cfe-9f489569b2b3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.153399 May 09 10:16:18.859853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1379/2754] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:18 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:19.082703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:19.083316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:19.089936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:19.090390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:19.091201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:19.091642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:19.220855 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:19.229550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90ec1e51-6d39-4e7f-a487-97eefac10c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150768 May 09 10:16:19.230322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1376/2755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:19.610363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:19.611132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:19.617380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:19.617833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:19.618592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:19.619054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:19.688377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:19.696846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fda7cefb-e80f-4c1b-980c-fd147aa38178 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090446 May 09 10:16:19.697522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1380/2756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:19.878061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:19.878729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:19.885308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:19.885767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:19.886604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:19.887017 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:20.026679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:20.035521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:20.037075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:20.038316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-edbd54cc-2e8a-410b-b86a-3bff8e6f58f0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.164304 May 09 10:16:20.038839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1377/2757] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:19 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:20.247350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:20.248243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:20.254691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:20.255137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:20.255906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:20.256344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:20.385086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:20.392993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7eff63de-948b-4bc9-a71b-de922ccd6a34 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.149801 May 09 10:16:20.393564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1381/2758] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:20.713797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:20.714417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:20.721451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:20.721906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:20.722690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:20.723137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:20.783985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:20.795378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3307de20-f9cf-4d45-b944-ffcb725fe9f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085255 May 09 10:16:20.796082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1378/2759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:21.056286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:21.056923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:21.063489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.063944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.064727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.065169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.196577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:21.205035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:21.206534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:21.207646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43609cd7-dfd1-4d76-973a-7df9559fc4a5 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.155301 May 09 10:16:21.208220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1382/2760] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:21 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:21.410107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:21.410917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:21.417893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.418446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.419327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.419846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.556773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:21.565319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fc54a7f-4431-43e9-917f-e8a79319f082 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159178 May 09 10:16:21.566053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1379/2761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:21.638292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-9f95f3cf-93dc-4374-9a5a-74ca553e1f57 req-4f575678-70a1-4705-ae14-8a2cc6cc9e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "name": "network-vif-plugged", "status": "completed", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:16:21.646877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9f95f3cf-93dc-4374-9a5a-74ca553e1f57 req-4f575678-70a1-4705-ae14-8a2cc6cc9e19 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.647319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-9f95f3cf-93dc-4374-9a5a-74ca553e1f57 req-4f575678-70a1-4705-ae14-8a2cc6cc9e19 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.659254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-9f95f3cf-93dc-4374-9a5a-74ca553e1f57 req-4f575678-70a1-4705-ae14-8a2cc6cc9e19 service nova] Creating event network-vif-plugged:001daf04-3f69-4af0-b1cf-e0ed36819de0 for instance 0e923da8-ef54-4364-a345-eb053850f0e6 on hv-cinder-84108 May 09 10:16:21.666204 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-9f95f3cf-93dc-4374-9a5a-74ca553e1f57 req-4f575678-70a1-4705-ae14-8a2cc6cc9e19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099604 May 09 10:16:21.666838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1383/2762] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:16:21.813193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:21.813807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:21.821013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.821486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.822271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:21.822710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:21.901097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:21.909587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0b293f95-678e-472f-935a-26dba5615af0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.100621 May 09 10:16:21.910104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1380/2763] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:22.230960 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:22.231582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:22.238439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:22.238885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:22.239659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:22.240093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:22.376383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:22.384270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:22.385788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:22.386928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b01432b-0645-430e-9d1d-b702f15710bb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.162878 May 09 10:16:22.387623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1384/2764] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:22 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:22.583456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:22.584058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:22.591339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:22.591786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:22.592570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:22.593047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:22.734438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:22.742633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ba915902-1d6b-4821-9ece-e3f9499d3ce5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163321 May 09 10:16:22.743201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1381/2765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:22.927032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:22.927620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:22.934496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:22.934952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:22.935726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:22.936162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:23.000474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:23.013103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2cba91ad-33f1-4de4-bac3-6e59727ea566 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090044 May 09 10:16:23.013718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1385/2766] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:23.405576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:23.406189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:23.412919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:23.413376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:23.414152 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:23.414594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:23.542541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:23.550779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:23.552301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:23.553438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ee871090-e565-4961-8fd1-517a5ab94d1d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1405 microversion: 2.20 time: 0.151912 May 09 10:16:23.554008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1382/2767] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:23 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:23.760929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:23.761604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:23.768054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:23.768504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:23.769313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:23.769752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:23.901150 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:23.909182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6b78974-c2e7-46c2-a0d9-48d1d966e7cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152244 May 09 10:16:23.909738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1386/2768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:24.030484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:24.031080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:24.037822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.038266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.039035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.039466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.103144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:24.111906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cac2ab78-d1fa-4c38-b9eb-527684eaf21a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085348 May 09 10:16:24.112255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1383/2769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:24.571684 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:24.572264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:24.579244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.579696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.580471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.580938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.715358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:24.724033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:24.725564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:24.726715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-646ce851-b129-4761-a1f9-65480375da8e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1598 microversion: 2.20 time: 0.159065 May 09 10:16:24.727280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1387/2770] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:16:24 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:16:24.744337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:24.744862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:24.751015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.751461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.752228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.752657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.839219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-317092d1-f6d6-4eb5-ac54-abcb25b1e334 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098692 May 09 10:16:24.839917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1384/2771] 10.222.0.26 () {60 vars in 1315 bytes} [Mon May 9 10:16:24 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:16:24.927053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:24.928187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:24.934207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.934653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:24.935434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:24.935870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:25.068816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:25.077153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-86d80b2a-05db-44bd-8f83-9d76e29dfe92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154027 May 09 10:16:25.077749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1388/2772] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:25.129553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:25.130197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:25.136480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:25.136972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:25.137743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:25.138167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:25.221652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:25.229875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e7f57d26-682a-4c17-9cd4-fa7852a88086 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.104614 May 09 10:16:25.230492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1385/2773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:26.093540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:26.094273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:26.101588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:26.101910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:26.102698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:26.103140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:26.130266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-1e2724b3-4d87-40e6-a3ce-63f8ef4187fd req-7caa19c3-649d-4b8a-8bd5-2bea15bd63a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:16:26.139882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-1e2724b3-4d87-40e6-a3ce-63f8ef4187fd req-7caa19c3-649d-4b8a-8bd5-2bea15bd63a8 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:26.140637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-1e2724b3-4d87-40e6-a3ce-63f8ef4187fd req-7caa19c3-649d-4b8a-8bd5-2bea15bd63a8 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:26.152353 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-1e2724b3-4d87-40e6-a3ce-63f8ef4187fd req-7caa19c3-649d-4b8a-8bd5-2bea15bd63a8 service nova] Creating event network-changed:001daf04-3f69-4af0-b1cf-e0ed36819de0 for instance 0e923da8-ef54-4364-a345-eb053850f0e6 on hv-cinder-84108 May 09 10:16:26.157887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-1e2724b3-4d87-40e6-a3ce-63f8ef4187fd req-7caa19c3-649d-4b8a-8bd5-2bea15bd63a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031482 May 09 10:16:26.158507 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1386/2774] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:16:26.244535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:26.252174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:26.253004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:26.263568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bfee8d83-8bed-4fb5-9c15-8109baa78451 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.173935 May 09 10:16:26.273283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1389/2775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:26.273484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:26.273484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:26.273484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:26.273484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:26.338391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:26.346883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d2e18c0-31c9-4a0a-90a7-59d6955c4078 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.098987 May 09 10:16:26.347462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1387/2776] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:27.280842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:27.281492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:27.288485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:27.289157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:27.289775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:27.290213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:27.363693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:27.364419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:27.371828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:27.372410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:27.373295 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:27.373799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:27.425964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:27.434591 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3a9601c-4366-40b1-8707-df64b1d8fd0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157592 May 09 10:16:27.435101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1390/2777] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:27.439142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:27.447135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e00ba5e9-ad8e-4d33-8c25-b5325606d85a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087412 May 09 10:16:27.447711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1388/2778] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:28.452024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:28.452826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:28.460129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:28.460577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:28.461516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:28.461948 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:28.463458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:28.464015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:28.471111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:28.471600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:28.472372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:28.472845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:28.534530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:28.543193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b85e8f1a-ad04-4102-bf47-2110eb44a8e0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083639 May 09 10:16:28.544143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1389/2779] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:28.600918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:28.609384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b87c8f02-9ce4-4d60-ac76-d272a4a13aa0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161763 May 09 10:16:28.609957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1391/2780] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:29.560462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:29.561107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:29.567851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:29.568301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:29.569124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:29.569554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:29.626725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:29.627460 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:29.633114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:29.634302 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:29.634759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:29.635555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:29.636129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:29.641182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d6a127c4-5892-4fcf-a7e9-ab7fe3aef3af tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084693 May 09 10:16:29.641754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1390/2781] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:29 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:29.769298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:29.780001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-03629b95-e16b-4b93-83ae-18060e853805 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157146 May 09 10:16:29.780600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1392/2782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:30.658746 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:30.659573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:30.667193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:30.667673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:30.668442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:30.668904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:30.735164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:30.743359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8affa49f-cbb2-4677-ac6d-33226eb27e73 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088676 May 09 10:16:30.743932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1391/2783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:30.800569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:30.801596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:30.810335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:30.810781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:30.811559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:30.811981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:30.945161 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:30.953661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c58b4f9c-7e8c-4abd-a1ca-4333ddd0466e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158905 May 09 10:16:30.954215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1393/2784] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:31.760271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:31.760951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:31.768048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:31.768866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:31.769666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:31.770109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:31.844117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:31.852564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-55f7b3bf-efaa-4853-a897-c9cd35f0be7d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096464 May 09 10:16:31.853176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1392/2785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:31.973984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:31.974622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:31.981547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:31.981997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:31.982802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:31.983236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:32.117778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:32.126088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6f4c910b-fd05-4371-b476-c363de0dd4dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156390 May 09 10:16:32.126662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1394/2786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:32.869946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:32.870590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:32.877461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:32.877906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:32.878670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:32.879100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:32.939866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:32.948291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3050900-00b0-4e8d-95f5-911a46308d1e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082224 May 09 10:16:32.948898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1393/2787] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:33.143797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:33.144422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:33.152018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:33.152483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:33.153304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:33.153718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:33.282030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:33.290265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a61d495d-76f4-40bf-a396-c7d3b2a2db81 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150670 May 09 10:16:33.290856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1395/2788] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:33.967840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:33.968421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:33.975476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:33.975919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:33.976689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:33.977146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:34.039111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:34.047347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e02a0102-2d0a-4392-971f-1522eda26a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083844 May 09 10:16:34.047937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1394/2789] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:34.308172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:34.308831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:34.316038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:34.316497 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:34.317425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:34.317848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:34.451765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:34.459952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-61dfef46-8a3f-4548-934c-0fde333cc802 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156302 May 09 10:16:34.460526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1396/2790] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:35.063565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:35.064248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:35.071103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:35.071557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:35.072336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:35.072846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:35.139245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:35.147560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6b15c041-f5c9-405e-8b99-0b9478ef7a99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087909 May 09 10:16:35.148162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1395/2791] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:35.477536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:35.478140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:35.484966 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:35.485413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:35.486182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:35.486609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:35.617746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:35.625978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ae561f9-77d9-478a-976b-4619d423b550 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152522 May 09 10:16:35.626559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1397/2792] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:36.164911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:36.165551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:36.176159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:36.176686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:36.177501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:36.177987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:36.242376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:36.250643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-216f8ab1-0aba-4334-a842-7301c8064c88 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089703 May 09 10:16:36.251244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1396/2793] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:36.643181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:36.643823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:36.650524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:36.650971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:36.651742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:36.652170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:36.781181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:36.792277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-457c2571-2082-42f2-ac4f-2aafb1d708d9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152921 May 09 10:16:36.792917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1398/2794] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:37.267594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:37.268424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:37.275122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:37.275567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:37.276539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:37.277018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:37.343809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:37.352122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bc11d8fa-97f8-4a0a-b0ec-14534044bcd5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088425 May 09 10:16:37.352720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1397/2795] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:37.809982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:37.810673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:37.817827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:37.818218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:37.818990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:37.819483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:37.976208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:37.984502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c4eef271-afce-4fd7-8e34-c62ff7754455 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.178614 May 09 10:16:37.985119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1399/2796] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:38.369816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:38.370497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:38.377707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:38.378158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:38.378949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:38.379366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:38.443916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:38.452300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-22451fd8-bde6-4997-a8ed-83dce7ea9a63 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086453 May 09 10:16:38.456847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1398/2797] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:39.001581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:39.002238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:39.009091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:39.009539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:39.010339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:39.010747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:39.144588 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:39.153282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f21a791c-cb64-47cd-af77-3f10093489ef tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155541 May 09 10:16:39.153858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1400/2798] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:39.469317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:39.470306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:39.477206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:39.477658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:39.478445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:39.478851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:39.544702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:39.553575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3bfbf16-1272-4725-a096-e72547bcbcdd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088205 May 09 10:16:39.554365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1399/2799] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:39 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:40.171129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:40.171763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:40.178712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:40.179164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:40.179943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:40.180383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:40.314930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:40.323687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0b3fd09c-00dd-4d96-943e-1b889ed8dad2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156460 May 09 10:16:40.324282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1401/2800] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:40.571948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:40.572565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:40.580002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:40.580447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:40.581294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:40.581696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:40.646020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:40.654271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68d17043-80c0-4747-8284-a39232ffe8d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086308 May 09 10:16:40.654852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1400/2801] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:41.341532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:41.342259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:41.350543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:41.350995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:41.351850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:41.352353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:41.491728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:41.505685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d0720581-a3c4-4f87-a8a2-df132bd52ced tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.168262 May 09 10:16:41.506414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1402/2802] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:41.671833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:41.672436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:41.679599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:41.680095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:41.680941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:41.681456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:41.751767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:41.760453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e73a9b3b-edc0-4d23-b39a-4d070496b7db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092880 May 09 10:16:41.761146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1401/2803] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:42.523571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:42.524315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:42.531694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:42.532251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:42.533136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:42.533597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:42.702985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:42.711532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1dfe3d9-741f-4b5a-9bd8-d9f21c0b991d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.192349 May 09 10:16:42.712050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1403/2804] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:42.779027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:42.779730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:42.786440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:42.786881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:42.787660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:42.788090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:42.855595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:42.864154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6356b2bc-c31a-45b4-9e56-4405ca893fde tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089476 May 09 10:16:42.864864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1402/2805] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:43.730678 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:43.731352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:43.739589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:43.740075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:43.740940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:43.741368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:43.883097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:43.884317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:43.888473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:43.892837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:43.893548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:43.894479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:43.895122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:43.899275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44e04529-86af-404c-afaf-cbbc0c5a5558 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172825 May 09 10:16:43.899954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1404/2806] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:43.968207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:43.977435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-14070691-6148-46ec-9b37-edcba28dc17f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.098907 May 09 10:16:43.977953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1403/2807] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:44.916234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:44.916945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:44.923863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:44.924315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:44.925126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:44.925572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:44.995315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:44.996004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:45.002705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:45.003161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:45.003953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:45.004372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:45.065945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:45.071416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:45.074935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f9e4ad55-fc3b-4838-9174-c0bf0c331460 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162487 May 09 10:16:45.075527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1405/2808] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:45.080093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f09b9735-bfeb-434a-ba13-491b6757a071 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088629 May 09 10:16:45.080709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1404/2809] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:46.092114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:46.092827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:46.098327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:46.098956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:46.100005 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:46.100463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:46.101390 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:46.101819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:46.106639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:46.107234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:46.108419 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:46.108925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:46.177160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:46.186182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6f429945-368b-4955-89f6-b4b0f6d0b9d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092376 May 09 10:16:46.186792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1405/2810] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:46.246974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:46.255775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d2892242-928a-45a4-a78e-3f5705755153 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167918 May 09 10:16:46.256372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1406/2811] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:47.203695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:47.204349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:47.211375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:47.211819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:47.212589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:47.213100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:47.273297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:47.274020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:47.277921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:47.282714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:47.283216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:47.284211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:47.284990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:47.286517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d480fbb-8a8f-446e-847c-b8d848618aae tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087158 May 09 10:16:47.287067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1406/2812] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:47.425154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:47.433932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e3e57e6-c6b0-4b98-a762-91bd519e11d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164600 May 09 10:16:47.434523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1407/2813] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:16:48.306176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:48.306948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:48.313874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:48.314324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:48.315093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:48.315503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:48.380653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:48.391120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5bb2e522-5a41-4e7f-9e49-f44c317aa768 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088545 May 09 10:16:48.391771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1407/2814] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:48 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:48.452996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:48.453654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:48.460402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:48.460870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:48.461663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:48.462680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:48.609197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:48.618119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3f6b38af-b318-427b-9503-2e7abefd0a6a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.170060 May 09 10:16:48.618725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1408/2815] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:49.412544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:49.413312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:49.419996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:49.420444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:49.421247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:49.421675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:49.489531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:49.498551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8711bfdc-f423-4406-9826-0c3442e8815e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089756 May 09 10:16:49.499157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1408/2816] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:49.634976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:49.635674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:49.642831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:49.643288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:49.644073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:49.644511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:49.788461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:49.797266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b072bce3-bf5e-4186-a1ed-cab0627401b3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166238 May 09 10:16:49.798094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1409/2817] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:50.515459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:50.516110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:50.523052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:50.523511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:50.524278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:50.524711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:50.586941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:50.595675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e25103e-5cc6-4252-ae05-cf9672ce07c5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084314 May 09 10:16:50.596263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1409/2818] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:50.814779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:50.815434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:50.822705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:50.823142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:50.823891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:50.824345 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:50.954783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:50.963396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9adfe605-2c1c-49c2-b099-1deb2949b816 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152575 May 09 10:16:50.963974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1410/2819] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:51.613041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:51.613631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:51.620717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:51.621176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:51.621974 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:51.622409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:51.689143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:51.697664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58d1ad85-f795-4985-bdc2-ac15bf9862d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088514 May 09 10:16:51.698243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1410/2820] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:51.980971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:51.981560 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:51.988228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:51.988704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:51.989457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:51.989893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:52.128269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:52.136556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5fb8b19d-3b01-46a0-b3ac-31f50166031e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159624 May 09 10:16:52.137165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1411/2821] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:52.715146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:52.715777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:52.722863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:52.723310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:52.724077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:52.724513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:52.785176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:52.793598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb0a4574-6580-463e-9423-141ce1d97efd tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082425 May 09 10:16:52.794185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1411/2822] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:53.154366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:53.155038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:53.161977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:53.162428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:53.163216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:53.163653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:53.305056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:53.314329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f4b9c74-af8b-4a70-bb2a-38a2ca453250 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164085 May 09 10:16:53.314958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1412/2823] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:53.812005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:53.812626 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:53.819483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:53.819939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:53.820739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:53.821211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:53.885360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:53.893782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d0f4599-f156-4423-ae42-398cff070a49 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085793 May 09 10:16:53.894364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1412/2824] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:54.331814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:54.332451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:54.339623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:54.340067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:54.340872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:54.341309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:54.475751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:54.484269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c06fc5d4-cf93-4097-a08c-07ab1f2e9b2b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156519 May 09 10:16:54.484880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1413/2825] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:54.911592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:54.912198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:54.918854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:54.919302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:54.920069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:54.920504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:54.985542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:54.994123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a52f977f-97cc-4fbd-bdc2-bf34c4d422a6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086407 May 09 10:16:54.994697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1413/2826] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:55.501889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:55.502543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:55.509348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:55.509854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:55.510624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:55.511058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:55.649291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:55.657834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29b17da8-0e43-469a-a4c4-ad3f4f545b6c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159912 May 09 10:16:55.658417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1414/2827] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:56.011739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:56.012397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:56.019182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:56.019630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:56.020453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:56.020895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:56.083178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:56.091508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5597ff98-f257-4e72-a5cc-8bb6ca36d88f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083856 May 09 10:16:56.092085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1414/2828] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:56.675676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:56.676332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:56.683606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:56.684030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:56.684890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:56.685298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:56.825164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:56.833856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5a354a2d-8bc3-4a6e-b596-66f290770382 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162017 May 09 10:16:56.834462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1415/2829] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:57.108534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:57.109201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:57.115892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:57.116339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:57.117145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:57.117572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:57.178957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:57.187250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-afbd6ab9-29c3-41fc-a5f5-625f37a59908 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082598 May 09 10:16:57.187831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1415/2830] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:57.851863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:57.852483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:57.859263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:57.859714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:57.860513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:57.861013 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:57.991229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:57.999803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16192c34-24a9-4555-a11b-9324bd42eb46 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151986 May 09 10:16:58.000361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1416/2831] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:58.204567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:58.205183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:58.212227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:58.212709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:58.213484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:58.213912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:58.278841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:58.286906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-69b515d1-52da-4ae2-83ea-1df443215fe6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086353 May 09 10:16:58.287560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1416/2832] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:58 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:59.017248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:59.017893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:59.025427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:59.025880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:59.026697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:59.027136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:59.162579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:59.170937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-636fafe8-50ac-4bd9-8854-658912536b5e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157604 May 09 10:16:59.171490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1417/2833] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:16:59.303675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:16:59.304296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:16:59.311322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:59.311778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:59.312561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:16:59.313032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:16:59.379174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:16:59.387401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-199e04fe-2ce9-4b0e-8e61-63772f470459 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087641 May 09 10:16:59.387978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1417/2834] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:16:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:00.188485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:00.189175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:00.196190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:00.196639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:00.197463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:00.197875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:00.349193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:00.357288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d2fe1af-8774-458f-b9de-7da6ac87ed41 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172712 May 09 10:17:00.357857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1418/2835] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:00.403604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:00.404236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:00.411055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:00.411550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:00.412313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:00.412788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:00.474767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:00.483193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-824b4589-5f7d-4530-a3da-6cbf17fe7355 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083554 May 09 10:17:00.483757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1418/2836] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:01.374492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:01.375120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:01.381822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:01.382266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:01.383027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:01.383461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:01.500603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:01.501250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:01.507757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:01.508213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:01.509012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:01.509481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:01.512043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:01.523427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3702f5af-d1dc-4532-a878-851cadeb5b49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152863 May 09 10:17:01.524490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1419/2837] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:01.575480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:01.583425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3907c0d0-6ebb-4721-9daf-6e20948329ac tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087837 May 09 10:17:01.583994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1419/2838] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:02.540997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:02.541626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:02.548625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:02.549128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:02.549889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:02.550284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:02.599866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:02.600522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:02.607237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:02.607684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:02.608450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:02.608901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:02.669745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:02.678166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4192de25-903a-4d1d-a7fc-80e14995a4d7 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082163 May 09 10:17:02.678754 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1420/2839] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:02.693439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:02.701423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4e79331e-bbba-457a-b3ab-2fba034b845b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164397 May 09 10:17:02.701952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1420/2840] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:03.695733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:03.696415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:03.703561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:03.703999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:03.704824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:03.705254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:03.718782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:03.719739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:03.726634 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:03.727077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:03.727854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:03.728357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:03.769427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:03.777826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ed7c78d8-0e5f-42a8-9cc1-6eba3cf4cfc5 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086477 May 09 10:17:03.778505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1421/2841] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:03.863189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:03.871663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21039985-0a7d-4a88-84b9-de4ccc3624fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156801 May 09 10:17:03.872593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1421/2842] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:04.795247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:04.795885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:04.802696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:04.803143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:04.803900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:04.804330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:04.866028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:04.874333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d57d3343-3898-49b8-a97d-b1a69f10558b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082988 May 09 10:17:04.874900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1422/2843] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:04.888543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:04.889265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:04.896188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:04.896688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:04.897434 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:04.897892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:05.027240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:05.035484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a30397f7-9e71-48e8-8d74-32bf2fa2af35 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150988 May 09 10:17:05.036031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1422/2844] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:05.891657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:05.892278 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:05.898919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:05.899365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:05.900131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:05.900569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:05.972635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:05.981544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bb28e467-ed5e-4546-a43e-2db840d310d1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093826 May 09 10:17:05.982171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1423/2845] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:06.052553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:06.053213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:06.060077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:06.060527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:06.061357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:06.061798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:06.194859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:06.202916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af32e25a-49c5-404e-b232-ccbfa4f97de7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154207 May 09 10:17:06.203506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1423/2846] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:06.999575 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:07.000234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:07.007100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:07.007555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:07.008322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:07.008789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:07.071592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:07.079733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-458f21a2-4592-4158-823e-8e897d0f712f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084105 May 09 10:17:07.080303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1424/2847] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:07.220875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:07.221531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:07.228872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:07.229322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:07.230141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:07.230572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:07.369116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:07.377562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e63cc454-5aac-4915-af8d-536179c2ec57 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160993 May 09 10:17:07.378129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1424/2848] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:08.097484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:08.098156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:08.105072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:08.105525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:08.106298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:08.106736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:08.167842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:08.176039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a3435c4e-f4e9-4d59-9e98-5fbfff25c857 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082961 May 09 10:17:08.176607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1425/2849] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:08 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:08.394797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:08.395411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:08.402392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:08.402839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:08.403602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:08.404030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:08.538355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:08.546947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5d490b98-18c0-49e9-bfbf-a22db5421c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156155 May 09 10:17:08.547529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1425/2850] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:09.193456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:09.194140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:09.201344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:09.201821 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:09.202658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:09.203123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:09.265953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:09.274911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09e4549f-5139-4211-81e5-620a9fd42d66 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085277 May 09 10:17:09.275499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1426/2851] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:09 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:09.564098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:09.564685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:09.572006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:09.572462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:09.573275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:09.573722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:09.709608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:09.718157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-79fa54a7-66cd-44de-aae7-9fb369b1c707 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158222 May 09 10:17:09.718720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1426/2852] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:10.292532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:10.293235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:10.300407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:10.300907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:10.301713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:10.302155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:10.365191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:10.373434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e42e2502-d26a-4df5-bab2-081c682ed6ce tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085073 May 09 10:17:10.374018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1427/2853] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:10 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:10.735331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:10.735929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:10.742777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:10.743318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:10.744058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:10.744487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:10.882261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:10.890353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d9a577b7-3b66-4374-9f4b-def6c32b1ae1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158909 May 09 10:17:10.890932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1427/2854] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:11.390890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:11.391550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:11.398417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:11.398869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:11.399939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:11.400409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:11.464606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:11.473416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb08acbe-0b2d-43b2-93ea-a7f83e607935 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086631 May 09 10:17:11.473994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1428/2855] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:11 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:11.907937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:11.908619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:11.915827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:11.916278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:11.917117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:11.917559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:12.056296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:12.066654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60a4b0d5-20a6-465e-a030-382589529790 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162572 May 09 10:17:12.067265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1428/2856] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:12.490474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:12.491088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:12.497785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:12.498239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:12.499021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:12.499455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:12.560832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:12.569291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e805cc4e-b347-4dae-833c-3a97458685db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.082659 May 09 10:17:12.569869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1429/2857] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:12 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:13.084226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:13.084912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:13.091855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:13.092316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:13.093106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:13.093562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:13.223578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:13.232198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c61cd58f-34bf-474a-a02f-d3d0861e6d8a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151844 May 09 10:17:13.232772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1429/2858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:13.586834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:13.587549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:13.594584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:13.595044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:13.595801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:13.596261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:13.661969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:13.670244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e7fa267-02b5-440c-8b64-0871d85db29c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087416 May 09 10:17:13.670816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1430/2859] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:13 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:14.249257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:14.249893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:14.257225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:14.257674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:14.258446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:14.258904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:14.401071 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:14.409894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f5774c6-f9af-4113-a41f-d883dc84be63 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164505 May 09 10:17:14.410490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1430/2860] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:14.687393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:14.688026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:14.694766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:14.695225 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:14.696004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:14.696542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:14.758692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:14.768149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3273e312-6d4c-4788-a1fc-f3e46398f5eb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084583 May 09 10:17:14.768717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1431/2861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:14 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:15.429639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:15.430268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:15.437667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:15.438127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:15.438896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:15.439325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:15.574171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:15.582486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3b339a45-c7a2-44a1-8553-ffef2d1bd092 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157902 May 09 10:17:15.583076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1431/2862] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:15.785800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:15.786434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:15.795547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:15.796021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:15.796832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:15.797261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:15.864442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:15.872555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73adb265-5901-4067-8adc-98545622cba9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090854 May 09 10:17:15.873160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1432/2863] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:15 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:16.600327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:16.601019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:16.608136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:16.608563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:16.609388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:16.609829 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:16.742537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:16.751096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f79240e5-0480-469f-8467-dba769ae1e3f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154714 May 09 10:17:16.751644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1432/2864] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:16.889790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:16.890459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:16.897455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:16.897897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:16.898653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:16.899082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:16.961996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:16.971500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3ff2ee5-99d5-4a51-870f-3fac489e00fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085644 May 09 10:17:16.972084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1433/2865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:16 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:17.768463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:17.769130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:17.776181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:17.776630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:17.777437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:17.777866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:17.913656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:17.922346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36bb8e5c-d22d-4096-8ca0-05e5ba8573f6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157809 May 09 10:17:17.922929 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1433/2866] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:17.988469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:17.989097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:17.996033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:17.996477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:17.997280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:17.997707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:18.062428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:18.071229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6fd16592-fa1d-4d56-b77f-5b24e92165aa tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086726 May 09 10:17:18.071983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1434/2867] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:17 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:18.940131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:18.940802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:18.947964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:18.948422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:18.949306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:18.949772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:19.090089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:19.090089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:19.094989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:19.097533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:19.098048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:19.098908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:19.099403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:19.103128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a3b33f2b-78b9-42f1-8d03-293d0277ab92 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167096 May 09 10:17:19.104069 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1434/2868] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:19.170497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:19.179896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63e7bd19-3881-4a55-bd82-90fb84cb1e69 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094348 May 09 10:17:19.180543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1435/2869] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:19 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:20.120561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:20.121326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:20.129472 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:20.130050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:20.130937 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:20.131392 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:20.197323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:20.197953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:20.206148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:20.206637 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:20.207480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:20.207919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:20.273914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:20.275310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:20.282866 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-865e3608-19d9-4bca-806d-088f1cd9b4ca tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167106 May 09 10:17:20.283227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b84bf83d-de8c-4b01-b0b6-aa21f73f8b96 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089956 May 09 10:17:20.283626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1435/2870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:20.283928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1436/2871] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:20 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:21.300569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:21.301235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:21.301600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:21.302211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:21.308156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:21.308598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:21.308939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:21.309381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:21.309515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:21.309816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:21.310159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:21.310593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:21.372699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:21.380838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee94ce79-4fa0-4ffb-b557-e63e1013ffea tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084103 May 09 10:17:21.381616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1436/2872] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:21 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:21.442148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:21.450291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-081e71b0-e884-439a-99f6-c6f08a2dce32 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152505 May 09 10:17:21.450859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1437/2873] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:22.398444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:22.399212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:22.406267 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:22.406714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:22.407493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:22.407928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:22.466797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:22.467542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:22.474604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:22.474778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:22.475053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:22.475824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:22.476253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:22.483304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c77c68ed-83e8-4a88-8e63-ba5146bad808 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088818 May 09 10:17:22.483897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1437/2874] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:22 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:22.606841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:22.615184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8083410b-8556-4190-b40b-c456c97bfa98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152301 May 09 10:17:22.615762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1438/2875] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:23.499858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:23.500498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:23.506980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:23.507429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:23.508192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:23.508628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:23.574719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:23.583120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f89f58f-1ee7-4107-992a-3ca854137525 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087387 May 09 10:17:23.583708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1438/2876] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:23 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:23.631581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:23.632197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:23.639122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:23.639577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:23.640350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:23.640859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:23.773961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:23.783105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da3c67b1-50fe-448f-8fc6-58b5a1637669 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155412 May 09 10:17:23.783666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1439/2877] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:24.599887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:24.600488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:24.607447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:24.607892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:24.608649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:24.609111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:24.669789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:24.677787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-097077b4-328a-4d1c-9c82-e48977882321 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.081809 May 09 10:17:24.678350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1439/2878] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:24 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:24.800208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:24.800862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:24.807813 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:24.808260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:24.809076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:24.809504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:24.940144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:24.948579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adfa69f2-2245-4875-9ada-5578154e574c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152260 May 09 10:17:24.949171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1440/2879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:25.695443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:25.696109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:25.703046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:25.703494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:25.704269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:25.704699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:25.771930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:25.780671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-935d373d-1c28-4723-b68d-36ed324dcd46 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089291 May 09 10:17:25.781295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1440/2880] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:25 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:25.966235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:25.966832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:25.974179 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:25.974630 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:25.975417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:25.975882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:26.116046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:26.124711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-16443e89-445f-4644-9389-fd2be27e353c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162447 May 09 10:17:26.125325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1441/2881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:26.797831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:26.798478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:26.805749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:26.806198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:26.807207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:26.807635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:26.874645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:26.884594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b67adead-9ed3-45c6-9797-b3ba777b5a9b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090600 May 09 10:17:26.885201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1441/2882] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:26 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:27.142441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:27.143101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:27.150023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:27.150508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:27.151269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:27.151699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:27.280956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:27.289469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aea2f1f3-acbb-4ce5-ac84-0e024d50b4c0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150967 May 09 10:17:27.290046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1442/2883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:27.902172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:27.902768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:27.909595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:27.910047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:27.910830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:27.911264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:27.973232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:27.981888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5df0043a-ef18-4159-9438-27277038d11f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083862 May 09 10:17:27.982692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1442/2884] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:27 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:28.305986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:28.306615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:28.313560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:28.314012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:28.314787 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:28.315221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:28.447860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:28.455844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-64b72c92-6b45-48ad-885c-3ac9b61413f1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153846 May 09 10:17:28.456421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1443/2885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:28.999695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:29.000291 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:29.007074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:29.007515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:29.008414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:29.008885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:29.073625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:29.082110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e92cf7c2-42df-4fdf-9b4b-4ef0fae8a332 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086381 May 09 10:17:29.082682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1443/2886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:28 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:29.473587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:29.474266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:29.481003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:29.481487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:29.482251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:29.482683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:29.617338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:29.625592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-52905fd2-5988-4300-a447-a4f56ab2ad6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155923 May 09 10:17:29.626204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1444/2887] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:30.099961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:30.100616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:30.107936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:30.108386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:30.109181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:30.109650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:30.174994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:30.183264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-747ff156-f9d2-4f02-9437-21fd5277c38c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087246 May 09 10:17:30.183841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1444/2888] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:30 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:30.646368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:30.647090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:30.656971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:30.657722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:30.659005 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:30.659736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:30.803503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:30.813145 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20c7ab57-f62b-46e7-aa57-30708f88159c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.173101 May 09 10:17:30.813711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1445/2889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:31.204857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:31.205781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:31.216610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:31.217405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:31.218987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:31.219734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:31.284652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:31.293223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8e3a17c3-1892-4d1d-bc03-31c37262d2db tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095033 May 09 10:17:31.293824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1445/2890] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:31 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:31.838245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:31.838824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:31.845865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:31.846313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:31.847076 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:31.847506 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:31.995015 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:32.006845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9f8744a3-ba0c-4722-9b65-d6d7f17f8e66 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174298 May 09 10:17:32.007588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1446/2891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:32.313597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:32.314530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:32.324721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:32.325437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:32.326641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:32.327254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:32.393935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:32.402143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-abaa934f-deb5-4369-a8cc-0cf301b228fb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094658 May 09 10:17:32.402709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1446/2892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:32 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:33.025390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:33.026039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:33.032885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:33.033350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:33.034124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:33.034552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:33.170910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:33.179509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f6fa48e6-ce20-4e70-81f3-2f7acee10171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158202 May 09 10:17:33.180202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1447/2893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:33.418989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:33.419641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:33.426590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:33.427038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:33.427803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:33.428240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:33.495593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:33.504854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e3ca29fc-ea35-43c8-bfbd-c694148daa8f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089725 May 09 10:17:33.505449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1447/2894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:33 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:34.197079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:34.198027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:34.205190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:34.205635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:34.206422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:34.206839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:34.350712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:34.364908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-96c9f29b-a141-4e07-8b1a-adf407b9e416 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.171355 May 09 10:17:34.365948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1448/2895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:34.522256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:34.522924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:34.529938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:34.530381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:34.531154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:34.531585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:34.597751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:34.606312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b59c6a2-7576-466c-a22a-1c2c7a7241cc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087891 May 09 10:17:34.606892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1448/2896] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:34 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:35.383729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:35.384423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:35.391537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:35.391985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:35.392798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:35.393233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:35.537321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:35.546040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33fc506e-2683-43cf-93b9-7d81e4aaa7a6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166500 May 09 10:17:35.546817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1449/2897] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:35.623975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:35.624686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:35.631663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:35.632106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:35.633100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:35.633537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:35.698297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:35.707094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e31ae168-f185-4d17-a7ed-103e5d968cad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.087127 May 09 10:17:35.707683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1449/2898] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:35 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:36.564050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:36.564792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:36.572416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:36.572900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:36.573701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:36.574128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:36.719631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:36.723645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:36.724508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:36.729001 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e419f570-071c-4491-abae-4392a254ee47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169106 May 09 10:17:36.729603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1450/2899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:36.734198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:36.734987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:36.736342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:36.737143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:36.809288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:36.818659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ce836d3-9d77-4419-bbee-73fd1043e992 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.098700 May 09 10:17:36.819384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1450/2900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:36 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:37.754399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:37.755020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:37.761815 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:37.762307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:37.763148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:37.763585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:37.841712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:37.842423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:37.850195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:37.850708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:37.851599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:37.852073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:37.922450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:37.924110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:37.931910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2a2bf928-9f70-4001-8c0e-94c0fa6bde90 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.094090 May 09 10:17:37.932559 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1451/2901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:37 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:37.933106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3cfac48-1a34-422e-ad4c-fa673d93e195 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.182755 May 09 10:17:37.933991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1451/2902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:38.950275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:38.950981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:38.951561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:38.952185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:38.957887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:38.958363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:38.958819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:38.959226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:38.959354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:38.959686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:38.960043 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:38.960481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:39.045589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:39.055419 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16504dde-59f9-42d9-8331-53542a6f800c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.109155 May 09 10:17:39.056496 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1452/2903] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:38 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:39.119910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:39.132803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8af1dfb0-887c-4c78-884b-a11aff89afcd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.184532 May 09 10:17:39.133850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1452/2904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:40.078550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:40.079195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:40.086798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:40.087361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:40.088219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:40.088712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:40.152607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:40.153309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:40.160563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:40.161038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:40.161868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:40.162281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:40.173522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:40.186996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e83fb814-f0e6-43ed-b6dc-c71846ec6a3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.112005 May 09 10:17:40.188135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1453/2905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:40 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:40.333732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:40.343230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f84460b4-e116-40e9-808e-18fa124873fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.195915 May 09 10:17:40.344139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1453/2906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:41.094155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:41.094765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:41.101646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:41.102228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:41.103099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:41.103606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:41.130294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-077cadac-a29f-49c2-a000-19e17a94db62 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/ips" status: 200 len: 153 microversion: 2.20 time: 0.040918 May 09 10:17:41.130977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1454/2907] 10.222.0.26 () {60 vars in 1288 bytes} [Mon May 9 10:17:41 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:17:41.207358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:41.208083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:41.216543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:41.217099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:41.217845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:41.218287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:41.287319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:41.296171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-37e292a0-fddb-4e3b-b9ec-1dde959a43e4 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092670 May 09 10:17:41.296816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1454/2908] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:41 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:41.362490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:41.362976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:41.371759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:41.372209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:41.373714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:41.374585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:41.527627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:41.544573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8909846d-2fb6-483a-80b4-a5672da2ecb1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.185799 May 09 10:17:41.545666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1455/2909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:42.314014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:42.314709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:42.321918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:42.322374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:42.323180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:42.323641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:42.390518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:42.403929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c96d7577-8796-4090-bfc3-6862c177278b tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.093580 May 09 10:17:42.404901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1455/2910] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:42.572094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:42.572938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:42.580316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:42.580798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:42.581582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:42.582017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:42.739557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:42.748928 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b131a97-b8e7-444a-a387-80984e5bf76a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.180959 May 09 10:17:42.749577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1456/2911] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:43.429951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:43.430971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:43.439434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:43.440028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:43.441012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:43.441688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:43.566836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:43.577432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-921e1db9-62ee-424e-a4d2-1293f386f844 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.152941 May 09 10:17:43.578045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1456/2912] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:43 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:43.767570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:43.768231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:43.775393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:43.775858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:43.776653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:43.777122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:43.929304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:43.938466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a5803f5d-83d4-4fae-bbca-8658d9c38879 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174845 May 09 10:17:43.939055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1457/2913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:44.596477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:44.597274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:44.605040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:44.605487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:44.606266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:44.606701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:44.671983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:44.680978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-801f08c0-c63a-41fc-8eee-01c6f50593a8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089037 May 09 10:17:44.681557 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1457/2914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:44 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:44.955830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:44.956531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:44.963632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:44.964086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:44.965076 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:44.965499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:45.123271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:45.132040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e72d6a80-0258-4a84-b7db-5390c6e3f180 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.180131 May 09 10:17:45.132633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1458/2915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:45.698772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:45.699516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:45.706602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:45.707025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:45.707841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:45.708253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:45.780997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:45.790540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-82fade91-ae74-43c3-92eb-8ffce8beccee tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095778 May 09 10:17:45.791178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1458/2916] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:45 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:46.149617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:46.150330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:46.157722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:46.158259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:46.159115 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:46.159616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:46.301930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:46.310982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-060288b9-b408-4e98-b977-cde4b8f89f11 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165365 May 09 10:17:46.311572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1459/2917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:46.810123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:46.810812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:46.819388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:46.819833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:46.820851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:46.821088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:46.904503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:46.913526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-559ec279-af50-4912-b002-34089505681c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.107701 May 09 10:17:46.914178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1459/2918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:46 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:47.333044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:47.333730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:47.341050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:47.341503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:47.342344 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:47.342774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:47.480246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:47.489342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f71297d6-a011-424b-ab37-d585af420cbf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160306 May 09 10:17:47.489969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1460/2919] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:47.931389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:47.931996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:47.939377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:47.939857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:47.940717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:47.941163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:48.007543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:48.016936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f846c4a2-9098-486d-bd23-403cfcdb9868 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.089670 May 09 10:17:48.018087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1460/2920] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:47 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:48.508160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:48.508901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:48.516626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:48.517133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:48.518043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:48.518617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:48.660539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:48.669197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09de7414-be87-441f-98f7-1f0dfc615146 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165505 May 09 10:17:48.669788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1461/2921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:49.037216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:49.038215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:49.045439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:49.045893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:49.046685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:49.047127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:49.120031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:49.128414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f65d1db1-f2b3-4f33-ba17-8e0d5e159fb8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096743 May 09 10:17:49.129062 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1461/2922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:49 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:49.687048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:49.687730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:49.695021 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:49.695543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:49.696389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:49.696875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:49.842582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:49.852505 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6c94f46-7cf7-4c7e-94fb-a58dd5c2c446 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169650 May 09 10:17:49.853304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1462/2923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:50.146692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:50.147266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:50.155432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:50.156196 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:50.157084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:50.157554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:50.228255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:50.239102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1066830c-6cd9-4a75-a553-5d307489c1e1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096908 May 09 10:17:50.239751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1462/2924] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:50 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:50.871918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:50.872598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:50.879545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:50.879978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:50.880854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:50.881286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:51.034155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:51.042549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8bf5c43b-c099-4c78-b8d7-f20f6dddf7d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174631 May 09 10:17:51.043137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1463/2925] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:51.263508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:51.264105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:51.271151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:51.271620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:51.272466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:51.272995 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:51.346905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:51.355537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3470db5b-d043-43a6-ba12-77ec8e0397df tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.096859 May 09 10:17:51.356277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1463/2926] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:51 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:52.061849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:52.062477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:52.069737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:52.070162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:52.070946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:52.071427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:52.216938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:52.226577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0c7854c6-9275-43cc-9864-665ab7912139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.168528 May 09 10:17:52.227171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1464/2927] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:52.373581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:52.374231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:52.381702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:52.382324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:52.383149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:52.383600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:52.449822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:52.458435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-260d2763-fa5b-444f-b269-9b6c1a912d8a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088697 May 09 10:17:52.459042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1464/2928] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:52 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:53.244719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:53.245378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:53.251812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:53.252275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:53.253063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:53.253503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:53.393688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:53.402251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c2be9084-1185-430c-855c-7bbe73fb4205 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161816 May 09 10:17:53.402841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1465/2929] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:53.479677 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:53.481818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:53.487792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:53.488418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:53.489396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:53.489967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:53.561961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:53.571309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5f2f3cba-18bb-42db-8aad-350fb642c1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.095533 May 09 10:17:53.571898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1465/2930] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:53 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:54.420315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:54.421125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:54.427892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:54.428334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:54.429152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:54.429567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:54.585806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:54.588730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:54.589518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:54.595106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ffaee8dc-3590-499d-9a59-f4d72b4fc21e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.178604 May 09 10:17:54.595970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1466/2931] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:54.599198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:54.599726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:54.600513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:54.601144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:54.666003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:54.674484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0fd1384e-ef26-4bfd-bc42-9b39e57ba186 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.090641 May 09 10:17:54.674977 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1466/2932] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:54 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:55.613282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:55.614080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:55.621237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:55.621697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:55.622488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:55.622941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:55.691310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:55.692105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:55.699323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:55.699770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:55.700555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:55.701025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:55.775577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:55.777255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:55.784880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-647ec378-da34-4196-9301-306660da8e38 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.097506 May 09 10:17:55.785470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1467/2933] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:55 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:55.797188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e0a69e17-c3e3-416d-9a6a-fbdcf7975ad7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.187603 May 09 10:17:55.798016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1467/2934] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:56.802269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:56.803280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:56.809801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:56.810243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:56.811044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:56.811490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:56.820513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:56.821195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:56.829190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:56.829721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:56.830672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:56.831178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:56.882715 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:56.891304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f87ea095-e732-434f-9e79-c090e36a960e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.092889 May 09 10:17:56.891872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1468/2935] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:56 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:56.977500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:56.986179 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2fc3d6b0-15a0-435a-be8b-678d49c0ffd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.170918 May 09 10:17:56.986898 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1468/2936] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:17:57.908830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:57.909421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:57.916389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:57.916886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:57.917671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:57.918095 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:57.984609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:57.993486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0281eef7-1de4-40e2-89a5-2849bbd9654a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088686 May 09 10:17:57.994063 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1469/2937] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:57 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:58.004053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:58.005641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:58.012728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:58.013185 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:58.013971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:58.014442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:58.175003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:58.184489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-09a37703-799a-434f-9f97-923dbfff5253 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.184636 May 09 10:17:58.185164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1469/2938] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:59.012279 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:59.013105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:59.024100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:59.024877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:59.026263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:59.027049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:59.105592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:59.114859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fe03fba8-00c1-4398-b699-bb2ba191567a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.107544 May 09 10:17:59.115555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1470/2939] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:59 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:17:59.204141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:17:59.205066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:17:59.214574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:59.215129 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:59.216205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:17:59.216724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:17:59.394442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:17:59.404295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-babcfed3-cf5d-4ce5-8c81-59c47d674c06 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.205425 May 09 10:17:59.405001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1470/2940] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:17:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:00.139301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:00.139989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:00.147203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:00.147724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:00.148496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:00.149036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:00.215040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:00.224117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6ffc2f6-cc03-414d-86ee-9ae0e9ea1139 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088889 May 09 10:18:00.224807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1471/2941] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:00 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:00.422293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:00.422899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:00.430494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:00.430947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:00.431827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:00.432260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:00.585305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:00.594254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-08c51e67-1614-49ba-b82e-a51e14f66fad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.175964 May 09 10:18:00.594860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1471/2942] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:01.241544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:01.242178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:01.248926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:01.249403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:01.250161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:01.250594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:01.568198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:01.576814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3081eef-d4f3-4c6e-8ebf-bb1c08e755b6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.339124 May 09 10:18:01.577392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1472/2943] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:01 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:01.611397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:01.611993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:01.618767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:01.619221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:01.619989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:01.620428 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:01.750528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:01.758689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d1ae7c47-f48f-4cbc-b1ef-240f79a3fd80 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151160 May 09 10:18:01.759282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1472/2944] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:02.595158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:02.595819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:02.602405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:02.602863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:02.603631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:02.604070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:02.665598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:02.674058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7dd95be9-e50c-4658-8080-2bc6db766f52 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.083240 May 09 10:18:02.674627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1473/2945] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:02 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:02.775851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:02.776439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:02.783280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:02.783732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:02.784504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:02.784970 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:02.918470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:02.926774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-41d2df18-9607-4514-b251-ee0d7e060a61 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154973 May 09 10:18:02.927354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1473/2946] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:03.693033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:03.693705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:03.700561 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:03.701058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:03.701829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:03.702280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:03.764535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:03.772969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d532535-1ff8-4d06-8b5a-e994c69d6007 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.084419 May 09 10:18:03.773586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1474/2947] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:03 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:03.944293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:03.944946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:03.951685 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:03.952127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:03.952933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:03.953361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:04.096729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:04.105520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-28b10c0e-3d3c-442b-a888-1fdda6e49232 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165190 May 09 10:18:04.106130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1474/2948] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:04.791924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:04.792560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:04.799374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:04.799837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:04.800604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:04.801061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:04.865548 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:04.874118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2b74a120-47e5-4b75-9878-eb9197534141 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.086190 May 09 10:18:04.874904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1475/2949] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:04 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:05.123192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:05.123804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:05.130215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:05.130669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:05.131438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:05.132004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:05.260309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:05.268278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-393bea71-df43-46a9-8e69-949c4ef0a508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.149083 May 09 10:18:05.268870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1475/2950] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:05.891194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:05.891788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:05.898605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:05.899068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:05.899844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:05.900291 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:05.963694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:05.972689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd4b66ee-939b-4d72-8f31-5534864b22d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.085512 May 09 10:18:05.973311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1476/2951] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:05 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:06.285823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:06.286410 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:06.293406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:06.293899 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:06.294723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:06.295181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:06.426498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:06.435148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6eeec747-e2e0-47c3-bef4-d19ae010ad8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153145 May 09 10:18:06.436077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1476/2952] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:06.990377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:06.991009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:06.997909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:06.998404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:06.999440 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:06.999910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:07.064789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:07.074421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f76a5044-b36d-412c-aa19-0fbbed999c6d tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 200 len: 1368 microversion: 2.1 time: 0.088008 May 09 10:18:07.075191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1477/2953] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:06 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:07.095278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72c98866-08e6-4d19-a5d3-3a7cb40b6188 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '.version_select at 0x7fa45efb9ee0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:07.115563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72c98866-08e6-4d19-a5d3-3a7cb40b6188 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208652429" status: 202 len: 0 microversion: 2.1 time: 0.026100 May 09 10:18:07.116285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1477/2954] 10.222.0.26 () {58 vars in 1220 bytes} [Mon May 9 10:18:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208652429 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:18:07.457706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:07.458852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:07.469577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:07.470388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:07.471773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:07.472533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:07.636732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:07.644778 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ef78722b-c1c7-4fb3-a681-428678d6e2dc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.194473 May 09 10:18:07.645512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1478/2955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:08.022022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0cffbb3f-dca6-4f06-bbaf-4f84a48ad707 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: .version_select at 0x7fa45ec0c040>, body: {"keypair": {"name": "tempest-keypair-1017090006"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:18:08.038280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0cffbb3f-dca6-4f06-bbaf-4f84a48ad707 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:18:08.042466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0cffbb3f-dca6-4f06-bbaf-4f84a48ad707 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for user f89c5ab1020947a9bece03af4c237480 and project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:18:08.134911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0cffbb3f-dca6-4f06-bbaf-4f84a48ad707 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:18:08.138477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-0cffbb3f-dca6-4f06-bbaf-4f84a48ad707 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for user f89c5ab1020947a9bece03af4c237480 and project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:18:08.151422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0cffbb3f-dca6-4f06-bbaf-4f84a48ad707 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.133778 May 09 10:18:08.152020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1478/2956] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 10:18:08 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:18:08.662878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:08.663496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:08.670210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:08.670705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:08.671663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:08.672111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:08.868261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:08.877206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-41f129db-1ef7-463c-be4c-1f1753676909 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.218260 May 09 10:18:08.877816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1479/2957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:09.536968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-465210652", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a20fcc2-3cfd-4768-9099-0b113691749f"}], "security_groups": [{"name": "tempest-securitygroup--1648989571"}], "key_name": "tempest-keypair-1017090006", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:18:09.654119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] validate_networks() for [('6a20fcc2-3cfd-4768-9099-0b113691749f', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:18:09.895662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:09.896308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:09.902707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:09.903104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:09.903865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:09.904292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:10.023578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:18:10.024039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:18:10.024518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:18:10.024925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:18:10.025362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:18:10.034498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:10.034954 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:10.035754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:10.036182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:10.040255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:10.048230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1ef68243-f96d-4c7a-b090-c9931b48f2e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157078 May 09 10:18:10.048824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1480/2958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:10.052932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:18:10.056942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Getting quotas for user f89c5ab1020947a9bece03af4c237480 and project c90b9a64e6a8464b9cde8bb967c4872d. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:18:10.071642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:18:10.075175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:18:10.122813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-94eb3ea4-d04e-49c4-923e-44fd335ab0b2 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591394 May 09 10:18:10.123542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1479/2959] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:18:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:18:10.133515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-73e1acb7-028f-4a17-bcb1-2c45855b716e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:10.134124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-73e1acb7-028f-4a17-bcb1-2c45855b716e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:10.187806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-73e1acb7-028f-4a17-bcb1-2c45855b716e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:10.194408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-73e1acb7-028f-4a17-bcb1-2c45855b716e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1237 microversion: 2.1 time: 0.064825 May 09 10:18:10.195068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1481/2960] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:10 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:11.066603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:11.067270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:11.077439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:11.077884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:11.078777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:11.079275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:11.211862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:11.213164 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:11.220619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:11.221390 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:11.222484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:11.222924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:11.238382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:11.247106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a8ceb63-4db3-4608-92bb-a14b67e99ea5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.185159 May 09 10:18:11.248773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1480/2961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:11.305869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:11.314839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-470d1a41-dbbe-4da8-9a17-312d07f0bbb6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1307 microversion: 2.1 time: 0.107297 May 09 10:18:11.315494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1482/2962] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:11 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:12.265598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:12.266223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:12.273090 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:12.273521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:12.274530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:12.274963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:12.331613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:12.332417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:12.339408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:12.339890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:12.340706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:12.341146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:12.414384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:12.422406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72804101-af96-46d8-ba1c-44c1a77aa894 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160812 May 09 10:18:12.423506 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1481/2963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:12.542929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:12.551721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1b1a0a33-75e7-4ce8-b9d2-12e07c50fa22 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.224045 May 09 10:18:12.552592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1483/2964] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:12 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:18:12.807718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-0509e1c7-19c0-4731-b0c3-c884b04cf7e2 req-ba023eda-775f-40a3-8761-baad303b3a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc", "tag": "21b1ea04-b927-4b84-a601-56c6f8deccfb"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:18:12.816608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-0509e1c7-19c0-4731-b0c3-c884b04cf7e2 req-ba023eda-775f-40a3-8761-baad303b3a3a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:12.817070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-0509e1c7-19c0-4731-b0c3-c884b04cf7e2 req-ba023eda-775f-40a3-8761-baad303b3a3a service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:12.829675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-0509e1c7-19c0-4731-b0c3-c884b04cf7e2 req-ba023eda-775f-40a3-8761-baad303b3a3a service nova] Creating event network-changed:21b1ea04-b927-4b84-a601-56c6f8deccfb for instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc on hv-cinder-84108 May 09 10:18:12.836189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-0509e1c7-19c0-4731-b0c3-c884b04cf7e2 req-ba023eda-775f-40a3-8761-baad303b3a3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092011 May 09 10:18:12.836510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1482/2965] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:18:13.440344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:13.440979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:13.447573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:13.448032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:13.448843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:13.449281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:13.571339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:13.572023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:13.578580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:13.579169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:13.579950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:13.580422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:13.585233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:13.593690 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9a10a7fa-729d-4610-8935-ae41d73fb9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157497 May 09 10:18:13.594301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1484/2966] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:13.712128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:13.720401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3c46ad59-48d8-4edd-997f-afd29821ea99 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.154422 May 09 10:18:13.721141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1483/2967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:13 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:14.610497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:14.611125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:14.617912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:14.618368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:14.619142 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:14.619576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:14.737630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:14.738203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:14.745567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:14.746014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:14.746754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:14.747205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:14.749340 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:14.757618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adb408a2-cc1e-471c-880a-322b9d869c43 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151033 May 09 10:18:14.758673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1485/2968] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:14.881317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:14.888993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-81f7e776-ce15-4d95-8a4e-972de34fe2bb tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.155306 May 09 10:18:14.889592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1484/2969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:14 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:18:15.775470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:15.776069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:15.782824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:15.783283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:15.784103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:15.784519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:15.905475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:15.906125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:15.913242 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:15.913692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:15.914475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:15.914910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:15.998528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:16.009230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c3f57d48-5002-420f-a188-21323c7c9e9c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.237358 May 09 10:18:16.010383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1486/2970] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:16.055681 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:16.063298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78300b6c-9928-46fe-85df-150a5b07ca42 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.161645 May 09 10:18:16.063925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1485/2971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:15 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:17.033178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:17.033807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:17.040586 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:17.041069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:17.041836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:17.042287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:17.080292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:17.080983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:17.089080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:17.090072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:17.091155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:17.091851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:17.181828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:17.190577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2758b711-4d9d-4f4f-944c-43b7c38d96bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161484 May 09 10:18:17.191166 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1487/2972] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:17.227286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:17.234824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3eb80a3e-3a6f-43dc-b962-5902d042e082 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.158307 May 09 10:18:17.235389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1486/2973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:17 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:18.207692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:18.208405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:18.215538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:18.216006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:18.216826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:18.217270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:18.252023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:18.253483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:18.260295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:18.260771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:18.261547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:18.261982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:18.349159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:18.357220 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ad0e0089-87f3-4d59-959f-082837c5ff77 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153469 May 09 10:18:18.357802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1488/2974] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:18.392804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:18.400221 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4099de81-f54d-4eac-98c7-50af97c86930 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.152287 May 09 10:18:18.400822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1487/2975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:18 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:19.374524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:19.375173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:19.381941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:19.382385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:19.383146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:19.383573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:19.417493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:19.418133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:19.425489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:19.425950 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:19.426764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:19.427215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:19.520143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:19.528377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ca4fe92f-5e4e-4a03-8c61-67ce0834158a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157684 May 09 10:18:19.529028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1489/2976] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:19.561081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:19.568515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-05b8c3d7-7c05-4dae-b292-27b3855e8bc8 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.154724 May 09 10:18:19.569606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1488/2977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:19 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:20.056819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-2f7a4c2e-6094-450b-addc-6f4228795ad7 req-c660de1c-ed29-4219-a2b0-b4f02f5f82a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc", "name": "network-vif-plugged", "status": "completed", "tag": "21b1ea04-b927-4b84-a601-56c6f8deccfb"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:18:20.065481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-2f7a4c2e-6094-450b-addc-6f4228795ad7 req-c660de1c-ed29-4219-a2b0-b4f02f5f82a8 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:20.065937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-2f7a4c2e-6094-450b-addc-6f4228795ad7 req-c660de1c-ed29-4219-a2b0-b4f02f5f82a8 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:20.079882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-2f7a4c2e-6094-450b-addc-6f4228795ad7 req-c660de1c-ed29-4219-a2b0-b4f02f5f82a8 service nova] Creating event network-vif-plugged:21b1ea04-b927-4b84-a601-56c6f8deccfb for instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc on hv-cinder-84108 May 09 10:18:20.085704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-2f7a4c2e-6094-450b-addc-6f4228795ad7 req-c660de1c-ed29-4219-a2b0-b4f02f5f82a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032898 May 09 10:18:20.086654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1490/2978] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:18:20.547881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:20.548459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:20.555408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:20.555826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:20.556630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:20.557062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:20.585896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:20.586680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:20.594480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:20.594975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:20.595900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:20.596518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:20.700334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:20.711002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-870dee7d-f2e5-41f2-ae1a-26594dce2af6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166933 May 09 10:18:20.711712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1489/2979] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:20.735574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:20.743306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-caa53c88-3022-42e7-b173-0008af126044 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.161536 May 09 10:18:20.743878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1491/2980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:20 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:21.729122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:21.729855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:21.736504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:21.736977 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:21.737759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:21.738191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:21.760245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:21.761167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:21.768019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:21.768487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:21.769333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:21.769920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:21.888380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:21.902924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f727f46c-d92c-484b-acd0-3bd1121aaf94 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.177768 May 09 10:18:21.903711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1490/2981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:21.921989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:21.929475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5db631bc-745a-48b3-a74d-7f81b73838ad tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1363 microversion: 2.1 time: 0.172997 May 09 10:18:21.930316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1492/2982] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:21 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:18:22.920996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:22.921649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:22.928811 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:22.929266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:22.930050 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:22.930525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:22.947371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:22.948046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:22.954773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:22.955218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:22.955993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:22.956398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:23.087195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:23.097183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-581b32a9-b71b-4d1c-a6c3-d31079ca42d7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.180130 May 09 10:18:23.098020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1491/2983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:23.102612 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:23.110256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c17bda5-6484-41c4-b948-0e6adf70117a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1550 microversion: 2.1 time: 0.166841 May 09 10:18:23.110840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1493/2984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:22 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:23.126912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:23.127399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:23.134201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:23.134715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:23.135488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:23.135940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:23.224610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7c58b0df-1080-4ba0-9d50-a2539d650676 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101604 May 09 10:18:23.225244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1492/2985] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 10:18:23 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:18:24.117374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:24.118281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:24.125762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:24.126206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:24.127007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:24.127432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:24.344306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:24.353168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-003b6808-5c86-4d90-890e-bb5c7f1b5b05 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.241587 May 09 10:18:24.354109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1494/2986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:24.577748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-7e4b20cc-4461-4cff-b64d-b8304bb6d6ce req-db25ce4a-9421-4ef7-a626-ea8c4b08ac96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc", "tag": "21b1ea04-b927-4b84-a601-56c6f8deccfb"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:18:24.587867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-7e4b20cc-4461-4cff-b64d-b8304bb6d6ce req-db25ce4a-9421-4ef7-a626-ea8c4b08ac96 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:24.588529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-7e4b20cc-4461-4cff-b64d-b8304bb6d6ce req-db25ce4a-9421-4ef7-a626-ea8c4b08ac96 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:24.602782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-7e4b20cc-4461-4cff-b64d-b8304bb6d6ce req-db25ce4a-9421-4ef7-a626-ea8c4b08ac96 service nova] Creating event network-changed:21b1ea04-b927-4b84-a601-56c6f8deccfb for instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc on hv-cinder-84108 May 09 10:18:24.609269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-7e4b20cc-4461-4cff-b64d-b8304bb6d6ce req-db25ce4a-9421-4ef7-a626-ea8c4b08ac96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036057 May 09 10:18:24.609894 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1493/2987] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:18:25.370918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:25.371590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:25.378452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:25.378959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:25.379689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:25.380121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:25.538067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:25.547584 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-50d71a76-67e1-4827-957c-341177b3bdb6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.180701 May 09 10:18:25.548151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1495/2988] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:26.568843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:26.569530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:26.576556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:26.577107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:26.577997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:26.578470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:26.727155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:26.740616 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3fd5f03e-1d1b-4e23-8652-39a461d79a75 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.177143 May 09 10:18:26.741735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1494/2989] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:27.759393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:27.760011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:27.767720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:27.768180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:27.768996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:27.769435 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:27.929377 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:27.937712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f4f2beb0-8dd5-4aa3-93fc-08e10a768d1f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.182702 May 09 10:18:27.938385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1496/2990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:28.965247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:28.965836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:28.973467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:28.973932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:28.974712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:28.975146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:29.140478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:29.150827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fee6fa8c-f32a-4b26-a24b-4cf9af6c8d6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.189500 May 09 10:18:29.151462 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1495/2991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:30.169226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:30.169866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:30.178358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:30.178812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:30.179730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:30.180163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:30.327523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:30.336770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-561d25b4-e382-4371-88b9-9884ac7cb5ea tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172021 May 09 10:18:30.337367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1497/2992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:31.361014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:31.361680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:31.370552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:31.371105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:31.372068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:31.372546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:31.529414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:31.544054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3ffabfa2-8125-43af-9c23-11233dce7a6d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.187949 May 09 10:18:31.545145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1496/2993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:32.563810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:32.564446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:32.578532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:32.579006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:32.579958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:32.580476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:32.729558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:32.738210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-95e56bc5-aec6-4b39-8af7-ef19ee711e6b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.178895 May 09 10:18:32.738795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1498/2994] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:33.764927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:33.765743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:33.775537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:33.775978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:33.776876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:33.777331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:33.936365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:33.945531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf88d63e-5bde-4aad-82ac-c0a6f5af145c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.186015 May 09 10:18:33.946153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1497/2995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:34.963470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:34.964090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:34.971224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:34.971675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:34.972449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:34.972924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:35.111499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:35.122182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c28200a-ae2f-42e6-ae02-b5274e14e2db tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162633 May 09 10:18:35.122804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1499/2996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:36.143112 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:36.143830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:36.150618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:36.151070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:36.151856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:36.152295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:36.286989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:36.295388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21277973-e3d5-4eab-8da9-e939dc098839 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156646 May 09 10:18:36.295973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1498/2997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:37.313033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:37.313711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:37.320375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:37.320861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:37.321598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:37.322052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:37.453190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:37.461724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fd7f6587-342c-4d06-b1fa-5efbdae45c30 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152655 May 09 10:18:37.462311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1500/2998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:38.479615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:38.480266 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:38.487084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:38.487531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:38.488285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:38.488712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:38.629192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:38.637693 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d680eabb-4caf-4792-9441-ac2c19c5de7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161891 May 09 10:18:38.638254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1499/2999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:39.655021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:39.655659 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:39.662549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:39.662999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:39.663766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:39.664194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:39.796832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:39.804918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-42ccddd1-96c9-4f19-b761-a7bea6ce7314 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153853 May 09 10:18:39.805509 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1501/3000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:40.822078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:40.822674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:40.829482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:40.829927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:40.830690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:40.831119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:40.961210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:40.969520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bb84e662-934b-457e-95d1-bb1b386423b8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151500 May 09 10:18:40.970156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1500/3001] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:41.986948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:41.987539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:41.994030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:41.994535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:41.995301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:41.995730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:42.129255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:42.137802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0e1778af-1d1c-415c-a497-58a56faf07fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154764 May 09 10:18:42.138482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1502/3002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:43.157332 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:43.158190 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:43.165923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:43.166467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:43.167682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:43.168307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:43.743057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:43.751464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b382e76f-5bb4-4de4-8d8f-08f09178f94d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.599549 May 09 10:18:43.752054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1501/3003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:44.769611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:44.770246 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:44.776595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:44.777087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:44.777852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:44.778282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:44.921151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:44.929681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2170f7c4-68f1-45d6-bb1b-f75fc2f8a63b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164046 May 09 10:18:44.930252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1503/3004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:45.947265 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:45.947872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:45.954601 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:45.955053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:45.955826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:45.956262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:46.095581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:46.105430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4b0b7508-0c9e-4ef6-8155-1e1993c6ab2e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162011 May 09 10:18:46.106152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1502/3005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:47.124865 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:47.125537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:47.133190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:47.133667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:47.134442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:47.134904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:47.286909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:47.295013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90bb1d19-e70f-4783-bc5d-ff21c8fe62c7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174708 May 09 10:18:47.295620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1504/3006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:18:48.312932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:48.313814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:48.321000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:48.321537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:48.322609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:48.323173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:48.472737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:48.481292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-70231145-b588-4925-8b6c-671f9c707c7a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172157 May 09 10:18:48.481756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1503/3007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:49.501767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:49.502383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:49.509140 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:49.509592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:49.510365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:49.510807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:49.656060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:49.664762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-56c5933b-abc3-4dc6-ae77-63e86eaa9509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166482 May 09 10:18:49.665009 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1505/3008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:50.681828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:50.682464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:50.689374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:50.689827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:50.690602 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:50.691037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:50.821212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:50.829574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5c566c38-410e-4e08-b604-cc668daecc6e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151660 May 09 10:18:50.830176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1504/3009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:51.847605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:51.848568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:51.855129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:51.855562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:51.856339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:51.856804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:51.999818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:52.008194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1cf93aa9-44be-4840-abbd-5d30dd4c6ba5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164655 May 09 10:18:52.008839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1506/3010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:53.025775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:53.026396 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:53.032867 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:53.033322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:53.034102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:53.034539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:53.172409 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:53.181349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-68014f93-4db2-4922-b8fd-0bcc5abfe0dd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159760 May 09 10:18:53.181910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1505/3011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:54.198864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:54.199504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:54.206256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:54.206710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:54.207474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:54.207909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:54.335519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:54.344622 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e0195c9-9532-48ae-a2eb-8f7de482701d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.149622 May 09 10:18:54.345255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1507/3012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:55.362493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:55.363118 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:55.369964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:55.370416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:55.371189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:55.371639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:55.499835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:55.508420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-495069ff-fafa-4d5e-89bf-dfb21f19b477 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.149858 May 09 10:18:55.509053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1506/3013] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:56.526381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:56.527026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:56.533944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:56.534407 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:56.535182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:56.535615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:56.676233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:56.683538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6430092a-8a7f-4249-aa1e-a934bf604b37 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161017 May 09 10:18:56.684104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1508/3014] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:57.700883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:57.701523 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:57.708348 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:57.708844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:57.709669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:57.710106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:57.839393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:57.847781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b281916-e806-4b0f-9e6b-7ae871473c7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150849 May 09 10:18:57.848435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1507/3015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:18:58.865632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:18:58.866282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:18:58.874041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:58.874498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:58.875318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:18:58.875752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:18:59.009391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:18:59.017322 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75a9cda4-6274-4d6a-9ef4-f5938b824263 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155971 May 09 10:18:59.017902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1509/3016] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:18:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:00.034884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:00.035599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:00.042999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:00.043442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:00.044233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:00.044643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:00.180165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:00.185628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7231080-86da-49f6-868a-a4d7e938f364 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154817 May 09 10:19:00.186204 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1508/3017] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:00.444990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:19:00.445613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:19:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:19:01.205570 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:01.206168 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:01.213298 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:01.213745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:01.214517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:01.214945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:01.344692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:01.352686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e38c00f3-7821-491f-af0d-98a842e4ef7f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151140 May 09 10:19:01.353258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1510/3018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:02.370660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:02.371358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:02.378143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:02.378593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:02.379471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:02.379912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:02.535903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:02.546415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-502412af-0f33-45cf-9e57-a9af84b13171 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.179602 May 09 10:19:02.547022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1509/3019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:03.564270 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:03.564941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:03.571905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:03.572338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:03.573178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:03.573619 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:03.704947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:03.713463 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-93f057b4-f917-4dd3-80c2-aacb5a7f411d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153052 May 09 10:19:03.714048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1511/3020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:04.731844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:04.732463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:04.739317 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:04.739762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:04.740532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:04.740996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:04.872723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:04.881128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-491d53b2-339a-499e-8472-e79605c8ec9a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153504 May 09 10:19:04.881694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1510/3021] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:05.072074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:19:05.072713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:19:05.897861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:05.898356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:05.905349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:05.905810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:05.906563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:05.906992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:06.036987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:06.045387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1c2126d1-22b5-4261-ade0-4c839b179904 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151642 May 09 10:19:06.045971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1512/3022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:07.130293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:07.130871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:07.137084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:07.137521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:07.138263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:07.138692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:07.266627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:07.274892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4448026-7a05-4b4e-bbd1-9ac56b2ce864 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.215912 May 09 10:19:07.275443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1511/3023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:08.291568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:08.292188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:08.299054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:08.299513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:08.300290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:08.300762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:08.442141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:08.450727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-17168c01-c42c-4cab-a5a8-27b52cb01a0f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163107 May 09 10:19:08.451303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1513/3024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:09.468077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:09.468751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:09.475350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:09.475800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:09.476564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:09.477040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:09.618064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:09.626300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2da0853b-7f28-4ed8-b5af-22cf2974dffb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162362 May 09 10:19:09.626883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1512/3025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:10.644007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:10.644685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:10.651405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:10.651853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:10.652624 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:10.653091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:10.780654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:10.791955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-60cc446a-2f1d-47b3-9b1c-b3497cf569bf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151744 May 09 10:19:10.792591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1514/3026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:11.809686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:11.810329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:11.817234 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:11.817594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:11.818341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:11.818795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:11.958838 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:11.969113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d80fc67-393f-411f-a4ba-49f6fa663149 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163245 May 09 10:19:11.969694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1513/3027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:12.986567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:12.987208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:12.993730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:12.994170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:12.994961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:12.995398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:13.135568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:13.144313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9925db9f-b146-4acc-9db4-854ccc749c50 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161606 May 09 10:19:13.145034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1515/3028] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:14.162531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:14.163201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:14.169972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:14.170417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:14.171196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:14.171628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:14.303544 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:14.311905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-414d5505-04ba-4d9d-87b6-35de9936a4ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153628 May 09 10:19:14.312520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1514/3029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:15.332345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:15.334157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:15.342986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:15.343464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:15.344296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:15.344785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:15.649193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:15.657524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-20127a04-eb3e-47cb-92cb-eb04c3409726 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.332268 May 09 10:19:15.658102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1516/3030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:16.674958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:16.675586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:16.682226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:16.682669 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:16.683399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:16.683855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:16.816012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:16.824512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b198f735-bfb4-466f-aa8b-57117cd42b1d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153475 May 09 10:19:16.825107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1515/3031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:17.842537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:17.843187 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:17.849938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:17.850388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:17.851148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:17.851576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:17.989479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:17.997489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0eef4d29-53ac-4ca0-8072-206979ed1cff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159302 May 09 10:19:17.998371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1517/3032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:19.015525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:19.016162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:19.022787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:19.023208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:19.023989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:19.024426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:19.180406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:19.188846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16775106-a0d2-4da6-b30f-c94db4fa8cd6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.177299 May 09 10:19:19.189456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1516/3033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:20.209653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:20.210404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:20.218854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:20.219393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:20.220317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:20.220857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:20.367436 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:20.376477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-19c43662-68f8-40ce-a6f0-5eb8dc78abdf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172460 May 09 10:19:20.377131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1518/3034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:21.402200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:21.403157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:21.409714 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:21.410194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:21.410979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:21.411418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:21.560252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:21.569793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3631d690-ebad-4b04-9ee5-a30e97a43c8b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.171428 May 09 10:19:21.570402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1517/3035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:22.588146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:22.588807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:22.596046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:22.596521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:22.597453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:22.597895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:22.745465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:22.754785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e86e9e46-74fb-4c58-9c9c-ace424e255fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.170502 May 09 10:19:22.755362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1519/3036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:23.772882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:23.773799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:23.779939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:23.780391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:23.781209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:23.781649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:23.923700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:23.932865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39e2a455-d873-4ae8-9b8f-64430230f52a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164133 May 09 10:19:23.933661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1518/3037] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:24.951768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:24.952386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:24.959339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:24.959793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:24.960595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:24.961044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:25.107592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:25.117218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-51064492-e97d-4e93-8656-566774cc59fb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169307 May 09 10:19:25.117860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1520/3038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:26.134645 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:26.135435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:26.142307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:26.142763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:26.143558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:26.144108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:26.287877 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:26.296643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-097cee8d-8180-4ecc-a0a7-4bc318e86d47 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165892 May 09 10:19:26.297316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1519/3039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:27.313975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:27.314618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:27.321294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:27.321736 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:27.322494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:27.322927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:27.458431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:27.467594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c9aa9d6-b622-460a-90a3-183edf40754f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157404 May 09 10:19:27.468185 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1521/3040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:28.484568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:28.485292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:28.492072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:28.492532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:28.493346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:28.493754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:28.645327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:28.654205 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ffe7be7a-55e6-406e-ab3c-d654f1a879e6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.173524 May 09 10:19:28.654802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1520/3041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:29.674621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:29.675310 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:29.682380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:29.682936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:29.683805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:29.684321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:29.827769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:29.836484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ab944893-52e7-49a8-9fd6-1be0d4c800d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166564 May 09 10:19:29.837085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1522/3042] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:30.854672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:30.855316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:30.862385 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:30.862830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:30.863613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:30.864039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:31.001837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:31.010257 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d9ddfa2a-6676-482a-a9a4-b59e4e1a470c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159714 May 09 10:19:31.010856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1521/3043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:32.027763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:32.028361 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:32.035004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:32.035451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:32.036227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:32.036687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:32.167870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:32.176035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c05ceb6f-a3af-461f-8ba3-19e7c7129375 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152289 May 09 10:19:32.176614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1523/3044] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:33.193597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:33.194253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:33.201089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:33.201522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:33.202320 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:33.202751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:33.345367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:33.353750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-75e4e657-7578-4b36-a50b-0e34636f1f71 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164153 May 09 10:19:33.354363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1522/3045] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:34.371000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:34.371656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:34.378634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:34.379096 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:34.379870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:34.380301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:34.509868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:34.518301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-78639e6a-fb59-49d6-a73a-c40630606618 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151229 May 09 10:19:34.518846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1524/3046] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:35.535831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:35.536485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:35.543672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:35.544125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:35.544931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:35.545402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:35.677863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:35.686293 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5043033a-9d2b-4081-9ca6-926a597cb278 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154557 May 09 10:19:35.686875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1523/3047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:36.608872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:36.609505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:36.616239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:36.616700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:36.617504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:36.617936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:36.642409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-53077413-bfa4-464c-a255-03d602462ec6 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/ips" status: 200 len: 147 microversion: 2.1 time: 0.037417 May 09 10:19:36.642906 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1525/3048] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 10:19:36 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:19:36.704155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:36.704806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:36.712412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:36.712922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:36.714391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:36.714391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:36.869105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:36.877521 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-07b67033-2e7d-47ba-94dd-fc0d8c97cd93 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.177581 May 09 10:19:36.878193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1524/3049] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:37.898178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:37.898775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:37.906078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:37.906527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:37.907293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:37.907721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:38.043950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:38.052212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d766b61b-494d-43b9-b068-ad696b9b2d69 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158068 May 09 10:19:38.052817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1526/3050] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:39.071309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:39.072282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:39.080327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:39.080807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:39.081665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:39.082300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:39.223292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:39.231665 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a2cbe63d-c73c-448e-afdb-277043b36ce0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164459 May 09 10:19:39.232502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1525/3051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:40.249830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:40.250481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:40.257308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:40.257790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:40.258574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:40.259067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:40.396360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:40.405228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da9b1773-1031-440f-91e5-a88286627896 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159334 May 09 10:19:40.405822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1527/3052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:41.423102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:41.423716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:41.430610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:41.431062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:41.431836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:41.432274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:41.565073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:41.573655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f09b41c1-f72d-47d8-b732-01b121f8526e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154554 May 09 10:19:41.574243 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1526/3053] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:42.591607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:42.592181 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:42.598852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:42.599288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:42.600087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:42.600523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:42.735693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:42.749305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63b57e78-e96a-4a96-bf6c-beb28792c6bc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161546 May 09 10:19:42.750285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1528/3054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:42 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:43.775906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:43.777215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:43.787493 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:43.787959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:43.789306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:43.789459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:43.924044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:43.932398 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-22300777-54f9-4b42-84b5-7ee0dddbb181 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161470 May 09 10:19:43.933166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1527/3055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:44.950244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:44.950940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:44.958243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:44.958695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:44.959483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:44.959914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:45.095929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:45.104346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e565ccc7-c786-4bee-a63a-c83061eae105 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158156 May 09 10:19:45.104940 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1529/3056] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:46.121810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:46.122561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:46.129300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:46.129742 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:46.130517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:46.130945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:46.268573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:46.277065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cbabb65a-3128-4697-a49c-1a281b9168f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159102 May 09 10:19:46.277648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1528/3057] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:47.294025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:47.294658 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:47.301496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:47.301942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:47.302708 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:47.303137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:47.431446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:47.439569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f8eae3e7-fce3-4fa1-a12e-caff5a06a148 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.149407 May 09 10:19:47.440260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1530/3058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:48.457270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:48.457920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:48.464440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:48.465438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:48.465689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:48.466439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:48.606535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:48.615148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6945c02a-8654-484b-871f-133465c8674c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161963 May 09 10:19:48.615732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1529/3059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:19:49.632432 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:49.633233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:49.640087 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:49.640531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:49.641326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:49.641772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:49.791826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:49.800354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d5b5f918-156b-4498-98ff-8606a7e3dcba tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.171774 May 09 10:19:49.800957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1531/3060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:50.818128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:50.818734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:50.825989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:50.826442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:50.827245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:50.827683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:50.967958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:50.976818 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0435fffc-646e-4d90-9251-221aba7a9edf tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162826 May 09 10:19:50.977432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1530/3061] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:51.993663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:51.994271 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:52.001255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:52.001718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:52.002567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:52.002992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:52.138204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:52.146474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-59d0e4d5-1cfb-41a7-b512-eeb1787f3675 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156880 May 09 10:19:52.147021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1532/3062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:53.164569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:53.165258 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:53.171887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:53.172314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:53.173125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:53.173557 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:53.305625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:53.313327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bfa22aa3-7cf3-4de3-8ac6-acb2b61167e8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153133 May 09 10:19:53.313914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1531/3063] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:54.330808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:54.331488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:54.338668 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:54.339150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:54.339949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:54.340512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:54.480460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:54.488799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-222f2507-366b-4b2c-8d4d-0ce201a741e2 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161917 May 09 10:19:54.489354 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1533/3064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:55.506627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:55.507289 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:55.514061 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:55.514502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:55.515263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:55.515695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:55.653734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:55.662059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45466e59-971d-4bac-bcb7-687bf1cc1d3c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159386 May 09 10:19:55.662639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1532/3065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:56.679578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:56.680692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:56.688150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:56.688598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:56.689408 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:56.689843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:56.825930 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:56.834896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-38f2d322-8eed-4678-bb53-de31fe5f46cd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159459 May 09 10:19:56.835487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1534/3066] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:57.852198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:57.852823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:57.859676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:57.860122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:57.860927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:57.861358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:57.995484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:58.003764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39feb65d-507c-46e1-9116-69ab1e580663 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155555 May 09 10:19:58.004391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1533/3067] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:19:59.021326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:19:59.022008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:19:59.028583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:59.029065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:59.029838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:19:59.030268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:19:59.162191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:19:59.170380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-474a2360-46d5-4159-9942-d9145faf1c23 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152986 May 09 10:19:59.170957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1535/3068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:19:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:00.187672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:00.188391 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:00.195480 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:00.195955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:00.196766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:00.197201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:00.337458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:00.346268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b4738440-c7f0-4039-a9bd-afd3e8c0d246 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162480 May 09 10:20:00.346834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1534/3069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:01.363732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:01.364376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:01.371374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:01.371876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:01.372687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:01.373125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:01.514634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:01.523066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-26d2cdc8-d43b-4a57-a57f-e600a8d96e87 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163366 May 09 10:20:01.523644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1536/3070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:02.539735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:02.540500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:02.547414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:02.547862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:02.548641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:02.549124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:02.683252 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:02.691621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e39c5a4a-0132-4692-94a2-0158f95771c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155811 May 09 10:20:02.692259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1535/3071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:02 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:03.709505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:03.710184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:03.722261 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:03.723155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:03.724491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:03.725335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:03.886512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:03.895233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2666d321-045d-46f6-8fbe-bb0c47add89b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.189587 May 09 10:20:03.895837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1537/3072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:04.912902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:04.913536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:04.920307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:04.920790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:04.921565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:04.921998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:05.060863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:05.073502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6c19c517-099e-4804-bf43-8effb0cdc857 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164567 May 09 10:20:05.074072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1536/3073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:06.091491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:06.092154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:06.099051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:06.099512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:06.100293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:06.100764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:06.236869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:06.245540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8c4b61af-70b5-45a4-ad7d-f5609705a4c1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158310 May 09 10:20:06.246105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1538/3074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:07.263182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:07.263853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:07.270744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:07.271180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:07.271953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:07.272387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:07.411048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:07.419666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8a10efb9-f4be-4465-8ac8-204fb91f6ff1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160408 May 09 10:20:07.420288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1537/3075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:08.437207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:08.437885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:08.444988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:08.445439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:08.446216 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:08.446660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:08.647710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:08.656077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2793ea87-41fc-4962-ae2b-babd4c65852a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.222898 May 09 10:20:08.656699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1539/3076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:09.674080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:09.674862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:09.682003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:09.682549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:09.683422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:09.683935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:09.901226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:09.911092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1db0a404-ce9d-47c3-9b47-4c9b7b6beef1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.241144 May 09 10:20:09.911865 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1538/3077] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:10.930504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:10.931289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:10.938343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:10.938837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:10.939667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:10.940207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:11.092332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:11.101157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c9e01ed3-0ce9-4e6c-a399-b95b8cdce000 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174432 May 09 10:20:11.101768 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1540/3078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:12.118892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:12.119654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:12.127170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:12.127619 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:12.128418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:12.128907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:12.272692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:12.281342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6f81d1cb-5070-40ff-bc69-707e6cffe563 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166468 May 09 10:20:12.281906 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1539/3079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:13.306961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:13.307885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:13.314664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:13.315097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:13.315894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:13.316343 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:13.453899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:13.462487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3126464-5222-4690-9245-92e424c8be4e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159595 May 09 10:20:13.463088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1541/3080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:14.486277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:14.487399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:14.495807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:14.496263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:14.497098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:14.497528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:14.638565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:14.647309 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bd41e3cf-de25-402f-9062-08d6772e1590 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.170470 May 09 10:20:14.647901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1540/3081] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:15.665127 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:15.665920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:15.672996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:15.673500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:15.674374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:15.674885 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:15.819853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:15.828545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d3db77c5-700d-4002-90cb-e21343679570 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167399 May 09 10:20:15.829230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1542/3082] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:15 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:16.848068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:16.848713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:16.858152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:16.858799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:16.859722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:16.860290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:17.002890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:17.012429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f926a6f-7b34-4987-9d94-816980de6e49 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169491 May 09 10:20:17.013142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1541/3083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:18.030589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:18.031239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:18.038262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:18.038707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:18.039482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:18.039910 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:18.175720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:18.184239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9d6073d0-269b-41c8-bd76-275a54b82754 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157623 May 09 10:20:18.184856 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1543/3084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:19.202136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:19.202880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:19.209620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:19.210084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:19.210826 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:19.211286 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:19.362778 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:19.371831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d81b505-4ad4-47d3-be56-05b8e62a83ff tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174166 May 09 10:20:19.372432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1542/3085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:20.390114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:20.390809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:20.398180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:20.398730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:20.399733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:20.400148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:20.549347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:20.559713 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1eabd66-e142-448e-9d16-514164779f3b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.173316 May 09 10:20:20.560811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1544/3086] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:21.579484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:21.580102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:21.587074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:21.587502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:21.588316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:21.588792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:21.726169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:21.734474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-60787661-bfde-42bd-a049-50b3ab08c5d0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159060 May 09 10:20:21.735151 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1543/3087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:21 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:22.752083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:22.752779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:22.759725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:22.760156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:22.761013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:22.761455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:22.904947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:22.913944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5471093-471d-403a-bb3e-e65958167191 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165626 May 09 10:20:22.914362 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1545/3088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:23.932730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:23.933715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:23.940611 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:23.941080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:23.941895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:23.942341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:24.085254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:24.096271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ddcbdaf-db95-4926-a96f-47e71807cb82 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.168357 May 09 10:20:24.096939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1544/3089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:20:25.113288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:25.113952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:25.121091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:25.121550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:25.122344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:25.122785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:25.257858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:25.266639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-75929dc7-64f8-4ffc-ab39-3d801ef28cbd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157033 May 09 10:20:25.267239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1546/3090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:26.284182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:26.285037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:26.292436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:26.292912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:26.293747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:26.294164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:26.446981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:26.455475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aba2d7f2-3adc-43de-add3-cfe49bfa7764 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.175603 May 09 10:20:26.456101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1545/3091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:27.473636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:27.474288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:27.481523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:27.482086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:27.482924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:27.483569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:27.620239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:27.628946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc69fb62-9b35-4a42-96e9-120ca956e28f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159396 May 09 10:20:27.629545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1547/3092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:28.646064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:28.646696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:28.653474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:28.653921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:28.654700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:28.655137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:28.800971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:28.809414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-21e14f29-0c22-41a6-9174-b8c1b4697cab tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167164 May 09 10:20:28.810015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1546/3093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:28 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:29.827389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:29.828139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:29.835399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:29.835859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:29.836654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:29.837131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:29.980948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:29.990588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a79b2886-48e2-4303-8faf-f6e560709502 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.167320 May 09 10:20:29.991389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1548/3094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:31.009500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:31.010157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:31.017310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:31.017752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:31.018531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:31.018956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:31.158991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:31.167618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-382da6b4-e69b-47ea-b905-0bb33927a9fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162277 May 09 10:20:31.168192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1547/3095] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:32.184656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:32.185371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:32.192233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:32.192702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:32.193519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:32.193962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:32.346101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:32.355092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-21b856f4-313e-4416-add2-dc4e6d54e708 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174386 May 09 10:20:32.355674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1549/3096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:33.371981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:33.372706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:33.379607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:33.380052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:33.380847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:33.381292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:33.524731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:33.533524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43dc4f37-dfb1-4866-9fc0-fe633286a30f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165550 May 09 10:20:33.534110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1548/3097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:34.551573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:34.552211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:34.559141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:34.559590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:34.560380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:34.560852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:34.702079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:34.711049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5dd8eb26-2228-459b-8f52-22ca5f54e230 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163578 May 09 10:20:34.711628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1550/3098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:35.729415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:35.730207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:35.738065 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:35.738511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:35.739337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:35.739772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:35.900857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:35.909464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ec5a0dce-c841-45ab-b35d-8b760f4efd7d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.184334 May 09 10:20:35.910067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1549/3099] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:35 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:36.927564 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:36.928160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:36.934935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:36.935386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:36.936156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:36.936600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:37.075840 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:37.085826 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9c547be6-1e6f-44b7-9586-3fedd4ae3dd0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162284 May 09 10:20:37.086412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1551/3100] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:38.103967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:38.104701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:38.112492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:38.112974 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:38.113761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:38.114197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:38.255431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:38.263632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef880fcf-e858-4f39-8d51-6fd64b10714d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163848 May 09 10:20:38.264180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1550/3101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:39.282805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:39.283777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:39.291002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:39.291451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:39.292232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:39.292647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:39.431428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:39.440008 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a71ba605-ab78-4d0d-9ee2-49432df06b09 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161859 May 09 10:20:39.440587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1552/3102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:40.457860 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:40.458547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:40.465534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:40.465969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:40.466744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:40.467172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:40.618753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:40.634250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ead8eeb-5a06-491d-88f9-f5368438484c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174005 May 09 10:20:40.634250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1551/3103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:41.648097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:41.648836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:41.655890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:41.656434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:41.657258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:41.657696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:42.051358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:42.060144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-063b4e89-98c4-4f9a-b9db-47d4b39818e5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.416228 May 09 10:20:42.060752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1553/3104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:43.078238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:43.078917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:43.085908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:43.086355 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:43.087142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:43.087567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:43.247133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:43.255920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-80552b7a-8356-4a9a-8d23-22d550dc456d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.181722 May 09 10:20:43.256518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1552/3105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:44.273676 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:44.274397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:44.281861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:44.282346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:44.283193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:44.283688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:44.418059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:44.427117 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-babaee5d-6d0b-495a-82fd-a6683b6d515d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158218 May 09 10:20:44.427784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1554/3106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:45.448232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:45.449099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:45.456039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:45.456482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:45.457283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:45.457713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:45.614121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:45.627427 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0892e479-d4a2-4615-9f6f-1bf0d47116a9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.182587 May 09 10:20:45.628235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1553/3107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:20:46.646060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:46.646785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:46.654232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:46.654723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:46.655587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:46.656104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:46.801634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:46.809989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-54f51831-85b6-4afe-8ad0-d96a1e0592c8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.168257 May 09 10:20:46.810574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1555/3108] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:47.831123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:47.831754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:47.838603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:47.839047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:47.840144 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:47.840571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:47.980550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:47.989025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-615c1bf4-6e20-4b3b-ad81-52f5427437c6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161726 May 09 10:20:47.989655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1554/3109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:49.007248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:49.007852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:49.014707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:49.015146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:49.015916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:49.016348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:49.152511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:49.161290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-985ea287-18c5-4155-a767-f6e510b532bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158154 May 09 10:20:49.161871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1556/3110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:49 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:50.178667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:50.179315 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:50.186113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:50.186561 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:50.187346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:50.187783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:50.320102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:50.328235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d6f8e68-8dec-41d2-8ea2-6bea16856557 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153493 May 09 10:20:50.328861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1555/3111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:51.346135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:51.349897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:51.354451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:51.354905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:51.356121 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:51.356933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:51.493852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:51.502114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-91223ff6-dcb7-427f-8a48-8bde46372721 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.160049 May 09 10:20:51.502700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1557/3112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:20:51.948857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:20:51.949470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:20:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:20:52.519710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:52.520321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:52.526979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:52.527430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:52.528206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:52.528641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:52.672078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:52.680566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4106f351-524f-45e3-b46b-eaa754b121c3 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.164952 May 09 10:20:52.681181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1556/3113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:53.699250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:53.699901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:53.708704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:53.709378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:53.710325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:53.710883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:53.870294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:53.878592 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-110ebec3-3bda-4bb9-9f33-594d415f3233 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.184297 May 09 10:20:53.879165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1558/3114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:54.896360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:54.897096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:54.903704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:54.904160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:54.904972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:54.905541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:55.041655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:55.050328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8dc34d57-fa3f-4653-9a3d-4d9147eb811c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158149 May 09 10:20:55.050901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1557/3115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:56.067965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:56.068631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:56.075735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:56.076189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:56.076987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:56.077572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:56.241929 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:56.260258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bdeb4ad5-7cb5-4111-a3e5-3391c97e4289 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.195807 May 09 10:20:56.261451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1559/3116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:56 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:57.292108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:57.292935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:57.301431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:57.301878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:57.302658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:57.303128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:57.450973 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:57.459642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce646f95-7c8a-4697-ac0d-6e04ffd01c52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.172941 May 09 10:20:57.460256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1558/3117] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:58.476686 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:58.477373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:58.484429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:58.484882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:58.485689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:58.486126 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:58.634180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:58.642615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c29808dc-34a0-4771-be22-15373b31862b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.169873 May 09 10:20:58.643451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1560/3118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:20:59.661073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:20:59.661717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:20:59.668123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:59.668562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:59.669420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:20:59.669830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:20:59.805333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:20:59.813623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c1f52d11-3071-4bf3-b2b7-8366e5a74584 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156764 May 09 10:20:59.814101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1559/3119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:20:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:00.210831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:21:00.211152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:21:00.834753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:00.835351 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:00.842329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:00.842882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:00.843662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:00.844091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:00.976705 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:00.985202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dca5ea95-fa91-4eb6-89a1-7523d4cc15ec tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154462 May 09 10:21:00.985793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1561/3120] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:02.003053 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:02.003785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:02.010567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:02.011004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:02.011769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:02.012196 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:02.155793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:02.170858 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8861580-cf9b-4875-a787-739c69c600ad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.171521 May 09 10:21:02.171903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1560/3121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:03.198183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:03.198863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:03.205897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:03.206378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:03.207155 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:03.207597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:03.353605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:03.362530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9687dec0-c601-41b1-b09a-0d43b494aa85 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.168289 May 09 10:21:03.363134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1562/3122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:04.379990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:04.380650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:04.387963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:04.388412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:04.389245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:04.389890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:04.521660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:04.529886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-43fb1948-4cc0-49d5-9bf9-419e290e30bb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153821 May 09 10:21:04.530587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1561/3123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:05.550348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:05.551423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:05.562100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:05.562100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:05.563228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:05.565444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:05.698756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:05.707113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2a2df6b-bb92-49df-9600-02365cddaffa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163559 May 09 10:21:05.707691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1563/3124] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:06.724852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:06.725562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:06.732339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:06.732806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:06.733727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:06.734172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:06.882146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:06.891106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b6b78a9a-32b0-460e-9930-ecdacc800983 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.170317 May 09 10:21:06.891706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1562/3125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:07.909890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:07.910483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:07.916943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:07.917388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:07.918149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:07.918578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:08.054860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:08.063250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9c3d2aa4-1b29-48ed-93d3-eec893a2b45e tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157353 May 09 10:21:08.063830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1564/3126] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:09.079785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:09.080567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:09.087240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:09.087686 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:09.088451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:09.088916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:09.222318 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:09.230765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-463b2607-69c3-467e-b238-07065e4088bd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155051 May 09 10:21:09.231365 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1563/3127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:09 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:10.250268 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:10.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:10.261793 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:10.262517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:10.263773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:10.264572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:10.417883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:10.426979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9b2539c-082b-433e-9f9f-3d6984f9c2d6 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.182019 May 09 10:21:10.427574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1565/3128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:10 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:11.448835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:11.449495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:11.456342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:11.456822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:11.457605 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:11.458058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:11.600006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:11.608582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8915166d-575a-422f-ac81-82dcb062d57a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163649 May 09 10:21:11.609193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1564/3129] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:11 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:12.625882 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:12.626529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:12.633051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:12.633499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:12.634272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:12.634751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:12.766744 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:12.775437 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f52ba1c9-6ac9-4f87-ba40-d820baccd4cc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153470 May 09 10:21:12.776018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1566/3130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:12 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:13.793032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:13.793724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:13.800207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:13.800654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:13.801438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:13.801868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:13.935852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:13.944793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-54e4d976-ccf3-40c0-b07d-7bad36faa287 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155480 May 09 10:21:13.945583 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1565/3131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:13 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:14.963323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:14.964280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:14.971240 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:14.971697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:14.972482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:14.972986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:15.113999 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:15.122002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-caad79dc-029f-4417-a103-0292d20d563a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163293 May 09 10:21:15.122610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1567/3132] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:14 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:16.138856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:16.139522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:16.146598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:16.147047 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:16.147835 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:16.148264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:16.281807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:16.290094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6fcd2da7-bb75-4f88-8e6c-9de42a51191b tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155212 May 09 10:21:16.290673 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1566/3133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:16 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:17.307577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:17.308254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:17.315394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:17.315825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:17.316613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:17.317075 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:17.448054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:17.456158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fcbf2c77-38cf-452c-9da5-e364036c1ffc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152500 May 09 10:21:17.456760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1568/3134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:17 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:18.474018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:18.474687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:18.481695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:18.482167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:18.483048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:18.483467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:18.628342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:18.636999 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-db735d1a-83ae-4c7c-a6f8-39d0f3f43b20 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.166901 May 09 10:21:18.637580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1567/3135] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:18 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:18.831471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:21:18.832060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:21:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:21:19.655133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:19.655782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:19.662485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:19.662941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:19.663719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:19.664159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:19.817737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:19.825881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-880c1500-a965-4422-afe1-5438ecddb5b1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.174991 May 09 10:21:19.826483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1569/3136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:19 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:20.844023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:20.844701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:20.851489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:20.851940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:20.852750 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:20.853191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:20.994508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:21.003180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7d626b3a-b8cb-4634-98a5-043c04249bad tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163042 May 09 10:21:21.005126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1568/3137] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:20 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:22.021470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:22.022064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:22.029189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:22.029718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:22.030501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:22.030935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:22.172320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:22.180994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c772cff8-7a95-49fb-a658-4a8d18b20c98 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163399 May 09 10:21:22.181582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1570/3138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:22 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:23.199331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:23.199975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:23.206728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:23.207176 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:23.207946 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:23.208389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:23.344018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:23.352102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-39a6fa5a-a0e4-480a-b12c-c36021a53871 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156889 May 09 10:21:23.352689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1569/3139] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:23 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:24.369857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:24.370500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:24.377342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:24.377792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:24.378572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:24.379002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:24.518670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:24.527067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-848dcb9d-3df3-4736-98b4-d8ffbd531509 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161684 May 09 10:21:24.527644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1571/3140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:24 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:25.544782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:25.545515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:25.552487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:25.552968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:25.553771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:25.554210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:25.691661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:25.699932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f52b55a-374c-429f-ae96-ed4cd8dd042c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159240 May 09 10:21:25.700511 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1570/3141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:25 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:26.718177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:26.718837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:26.725716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:26.726163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:26.726943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:26.727371 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:26.858789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:26.866891 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b21fe10e-29e0-473e-84e1-b86912ed72b4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152979 May 09 10:21:26.867467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1572/3142] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:26 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:27.884942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:27.885537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:27.892335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:27.892813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:27.893580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:27.894014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:28.026516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:28.035593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fa6dfdbc-eda4-43fb-85ab-e4e8dea34784 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154779 May 09 10:21:28.036175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1571/3143] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:27 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:29.052936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:29.053543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:29.060376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:29.060854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:29.061615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:29.062045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:29.191003 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:29.199199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb61e48e-616b-42ae-8677-076a436593f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150239 May 09 10:21:29.199771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1573/3144] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:29 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:30.218857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:30.219550 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:30.226715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:30.227169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:30.227959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:30.228400 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:30.377787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:30.386662 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d2dbfb9-9ead-47cd-a72a-183b55bcadac tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.173262 May 09 10:21:30.387262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1572/3145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:30 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:31.404228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:31.404905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:31.411833 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:31.412282 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:31.413103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:31.413544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:31.549632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:31.558128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-62b6bdc6-91f5-47b4-8883-ef5506739634 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157826 May 09 10:21:31.559606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1574/3146] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:31 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:32.575668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:32.576311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:32.583374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:32.583809 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:32.584594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:32.585059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:32.720613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:32.729027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9821fc7-891c-4082-b7e3-e04221d7b659 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.157296 May 09 10:21:32.729626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1573/3147] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:32 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:33.752846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:33.753522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:33.760245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:33.760691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:33.761472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:33.761904 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:33.896131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:33.904418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-08c63c65-968a-42ce-ad0b-c834dc1a923a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155742 May 09 10:21:33.905025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1575/3148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:33 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:34.922125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:34.922722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:34.929472 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:34.929919 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:34.930697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:34.931130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:35.065087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:35.073606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-114badae-1738-4c28-87f2-b49b68c858f5 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155697 May 09 10:21:35.074189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1574/3149] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:34 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:36.093052 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:36.093795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:36.101329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:36.101803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:36.102580 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:36.103011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:36.240691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:36.249406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2e8382a5-dc19-48ac-b5a8-5a3d8279eb53 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.161107 May 09 10:21:36.249987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1576/3150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:36 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:37.267171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:37.267831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:37.274878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:37.275335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:37.276101 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:37.276541 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:37.414799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:37.423015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9955a9a8-78b4-4983-be18-db00082f512a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159877 May 09 10:21:37.423582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1575/3151] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:37 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:38.440386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:38.441071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:38.447825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:38.448277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:38.449085 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:38.449520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:38.583357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:38.591805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-58bc6a6c-3937-4241-acac-16d3e0f4bf02 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155363 May 09 10:21:38.592368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1577/3152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:38 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:39.612757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:39.613553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:39.620481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:39.620989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:39.621753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:39.622394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:39.753177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:39.761507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c8fc481-2de8-48e1-bc6e-34c280566de8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152802 May 09 10:21:39.762088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1576/3153] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:39 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:40.779294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:40.779933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:40.786896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:40.787349 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:40.788125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:40.788559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:40.920504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:40.929288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-633e3349-5d82-4d3c-86b8-aee4b6f4a185 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154046 May 09 10:21:40.929869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1578/3154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:40 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:41.948259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:41.948904 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:41.956169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:41.956613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:41.957425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:41.957855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:42.098644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:42.107931 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee6df95f-61bc-4884-ba2c-e5e9c65f90f4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.163643 May 09 10:21:42.108515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1577/3155] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:41 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:43.125355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:43.126014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:43.132393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:43.132879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:43.133650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:43.134077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:43.268293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:43.276835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70a8321d-6fcf-4176-a0c9-54efb6d41a7c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.155650 May 09 10:21:43.277409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1579/3156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:43 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:44.294165 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:44.294825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:44.302038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:44.302482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:44.303248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:44.303680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:44.435709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:44.444186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-59070a7e-7258-4822-a60a-1c0c82e34096 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153912 May 09 10:21:44.444772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1578/3157] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:44 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:45.461662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:45.462311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:45.469471 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:45.469925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:45.470697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:45.471128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:45.603494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:45.611785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07579a17-cf47-4128-b80d-49360bef0508 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154078 May 09 10:21:45.612350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1580/3158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:45 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:46.628883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:46.629519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:46.636276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:46.636747 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:46.637504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:46.637933 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:46.767376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:46.776371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ca365419-b8f7-4c49-911e-c74265893e4c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151487 May 09 10:21:46.776984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1579/3159] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:46 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:47.793895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:47.794533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:47.801016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:47.801472 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:47.802242 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:47.802679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:47.938641 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:47.946756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-25263c54-bad2-4a11-8bde-8219168bcf52 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156818 May 09 10:21:47.947342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1581/3160] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:47 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:48.964798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:48.965439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:48.972388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:48.972874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:48.973646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:48.974078 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:49.110756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:49.119104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d3ae4805-9360-43bf-beb5-c0f931c4f381 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.158575 May 09 10:21:49.119696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1580/3161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:48 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:50.136916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:50.137595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:50.144344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:50.144839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:50.145881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:50.146318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:50.278151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:50.286835 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c136496c-f66f-498f-b2c0-b9c0adf84a07 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.154233 May 09 10:21:50.287411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1582/3162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:50 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:51.303677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:51.304300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:51.311316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:51.311764 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:51.312539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:51.313007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:51.443896 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:51.453412 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-809d1183-c43f-4167-a4da-eddbfba13fa4 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153586 May 09 10:21:51.453990 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1581/3163] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:51 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:52.472011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:52.472997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:52.482114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:52.482558 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:52.483326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:52.483753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:52.624942 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:52.633400 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ea797499-6e08-4bf2-aa07-19879c4c6179 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.165617 May 09 10:21:52.633979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1583/3164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:52 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:53.650741 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:53.651373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:53.657891 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:53.658342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:53.659108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:53.659540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:53.806106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:53.815059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c003b40-5df5-437f-bee0-32b69edbcbdc tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.168173 May 09 10:21:53.815542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1582/3165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:53 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:54.832749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:54.833346 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:54.840613 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:54.841102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:54.841876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:54.842315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:54.971542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:54.980030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09b68005-4d31-4c5c-b95f-f034b77a1c38 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151429 May 09 10:21:54.980587 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1584/3166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:54 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:55.997875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:55.998454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:56.006475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:56.006958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:56.007823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:56.008314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:56.146654 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:56.156455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d847b300-94ca-4f74-abc4-458ce4a72139 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.162712 May 09 10:21:56.157059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1583/3167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:55 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:57.174877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:57.175579 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:57.182303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:57.182733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:57.183545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:57.184070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:57.312933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:57.321019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e958437e-a774-42fe-ac18-64462b75c867 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.150191 May 09 10:21:57.321608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1585/3168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:57 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:58.338759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:58.339423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:58.346079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:58.346563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:58.347334 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:58.347748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:58.478430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:58.487238 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f074c314-158c-41fc-8e6a-66fe294441ce tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152756 May 09 10:21:58.487819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1584/3169] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:58 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:21:59.505760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:21:59.506417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:21:59.513241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:59.513701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:59.514481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:21:59.514917 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:21:59.653251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:21:59.661344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac274772-70c1-4f65-b2be-3a0f780184f9 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159655 May 09 10:21:59.661916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1586/3170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:21:59 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:00.678812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:00.679467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:00.686328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:00.686774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:00.687537 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:00.687965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:00.820091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:00.828572 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2c79449a-5fac-4f91-9484-52c7d6a16862 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153650 May 09 10:22:00.829237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1585/3171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:00 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:01.846926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:01.847545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:01.854257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:01.854712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:01.855485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:01.855969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:01.987470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:01.995896 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d442c8c6-db92-4ff4-ab17-abdb69a198fa tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.153031 May 09 10:22:01.996479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1587/3172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:01 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:03.013067 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:03.013666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:03.020504 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:03.020994 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:03.021758 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:03.022193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:03.151554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:03.160094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1dd9081d-4883-4b49-a7cc-76896109f2d1 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.151015 May 09 10:22:03.160702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1586/3173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:03 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:04.177689 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:04.178358 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:04.185148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:04.185588 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:04.186381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:04.186811 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:04.324245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:04.332979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6ba0745-d05a-4b5d-9394-25c57853752f tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.159076 May 09 10:22:04.333567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1588/3174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:04 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:05.355789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:05.356401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:05.363350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:05.363799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:05.364576 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:05.365044 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:05.499849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:05.508475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1fd66ccb-ee20-48df-b9ac-84d7c08e26da tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156753 May 09 10:22:05.509094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1587/3175] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:05 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:06.525556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:06.526249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:06.533090 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:06.533549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:06.534311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:06.534734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:06.666330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:06.674416 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cb9432e4-9b24-4ad8-9860-ad287ec2dbe8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152806 May 09 10:22:06.674968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1589/3176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:06 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:07.692064 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:07.692707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:07.699531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:07.699984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:07.700796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:07.701240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:07.836106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:07.844951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-11673b13-51fd-459b-9c7b-f39a8d9c4f8c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.156830 May 09 10:22:07.845546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1588/3177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:07 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:08.862466 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:08.863072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: cff08bd0-07e6-4fd9-9dba-ed7381d86652] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:22:08.869814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:08.870269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:08.871068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:08.871528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:09.003180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:22:09.011277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3e84470e-f755-414c-95f2-19cb7b60184a tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652" status: 200 len: 1736 microversion: 2.1 time: 0.152835 May 09 10:22:09.011848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1590/3178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:22:08 2022] GET /compute/v2.1/servers/cff08bd0-07e6-4fd9-9dba-ed7381d86652 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:22:09.027438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a6014221-a530-46b3-a3c9-a1b63fc9eaeb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '.version_select at 0x7fa45ef35d30>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:22:09.047388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a6014221-a530-46b3-a3c9-a1b63fc9eaeb tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643973997" status: 202 len: 0 microversion: 2.1 time: 0.023971 May 09 10:22:09.047986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1589/3179] 10.222.0.26 () {58 vars in 1220 bytes} [Mon May 9 10:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1643973997 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:22:09.977530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-3878e650-b44c-40e6-b022-6f57f6055b9b req-ca728d79-7771-44a7-a147-9042d656e043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:22:09.986165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3878e650-b44c-40e6-b022-6f57f6055b9b req-ca728d79-7771-44a7-a147-9042d656e043 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:22:09.986604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-3878e650-b44c-40e6-b022-6f57f6055b9b req-ca728d79-7771-44a7-a147-9042d656e043 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:22:09.998366 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-3878e650-b44c-40e6-b022-6f57f6055b9b req-ca728d79-7771-44a7-a147-9042d656e043 service nova] Creating event network-changed:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 10:22:10.004522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-3878e650-b44c-40e6-b022-6f57f6055b9b req-ca728d79-7771-44a7-a147-9042d656e043 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 May 09 10:22:10.005224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1591/3180] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:22:20.454552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:22:20.455300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:22:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:22:25.081406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:22:25.082253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:24:04.935861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ded39a2b-cd09-4969-a4bf-b3349bb77630] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 09 10:24:04.940012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c4878c0-69d9-403d-89e1-8109b4bb77b0"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:04.941105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:04.949154 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:04.949713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:04.950726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:04.951249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:05.048152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [3a99f4ae-ff59-4b99-af25-f4f24b9787d2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 10:24:05.432103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ce6fa76-c806-4301-8d14-da40d6f02e53] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 09 10:24:05.436259 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:05.436913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:05.443110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:05.443556 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:05.444800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:05.445442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:05.470857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lazy-loading 'flavor' on Instance uuid 0e923da8-ef54-4364-a345-eb053850f0e6 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:24:05.765387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0951d6be-b079-4df6-a9ec-4027e64e4e89 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/action" status: 202 len: 0 microversion: 2.20 time: 0.334882 May 09 10:24:05.766014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1592/3181] 10.222.0.26 () {62 vars in 1318 bytes} [Mon May 9 10:24:05 2022] POST /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 10:24:05.775932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:05.776914 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:05.784234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:05.784701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:05.785482 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:05.785944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:05.931850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:05.943480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:05.945139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:05.946321 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-41cd81a6-70d2-48b9-ac86-569da2f6b980 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.174543 May 09 10:24:05.946526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] [ded39a2b-cd09-4969-a4bf-b3349bb77630] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49304. May 09 10:24:05.947019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1593/3182] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:05 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:06.056010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [3a99f4ae-ff59-4b99-af25-f4f24b9787d2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49312. May 09 10:24:06.954807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b1b72919-6a09-475b-89c2-700ef84f7672 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.022528 May 09 10:24:06.955664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1590/3183] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:24:04 2022] POST /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments => generated 194 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:06.964873 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:06.965485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:06.972741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:06.973458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:06.974417 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:06.975047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:07.017035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ce6fa76-c806-4301-8d14-da40d6f02e53] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49324. May 09 10:24:07.497019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:07.505423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:07.506927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:07.508101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8a0c330c-dda4-4b73-b3d1-2ece52663233 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.547217 May 09 10:24:07.508634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1594/3184] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:06 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:07.920759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-1a7a24d4-cb89-47f4-beca-301ca99949e8 req-509600ca-961c-4680-9baf-264cb86bb748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba59db3d-90cd-4f89-9b7a-31e36bab75eb", "name": "network-vif-deleted", "tag": "aae37ee9-ba7e-4ac4-84da-717f219440f4"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:07.929534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-1a7a24d4-cb89-47f4-beca-301ca99949e8 req-509600ca-961c-4680-9baf-264cb86bb748 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:07.929945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-1a7a24d4-cb89-47f4-beca-301ca99949e8 req-509600ca-961c-4680-9baf-264cb86bb748 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:07.942668 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-1a7a24d4-cb89-47f4-beca-301ca99949e8 req-509600ca-961c-4680-9baf-264cb86bb748 service nova] Creating event network-vif-deleted:aae37ee9-ba7e-4ac4-84da-717f219440f4 for instance ba59db3d-90cd-4f89-9b7a-31e36bab75eb on hv-cinder-84108 May 09 10:24:07.948810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-1a7a24d4-cb89-47f4-beca-301ca99949e8 req-509600ca-961c-4680-9baf-264cb86bb748 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163809 May 09 10:24:07.949709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1591/3185] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:08.527165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:08.527819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:08.534082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:08.534535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:08.535304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:08.535773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:08.673830 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:08.681933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:08.683442 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:08.684615 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-aad18598-bbcd-4e45-b358-46a9c0aa7bad tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.161570 May 09 10:24:08.685202 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1595/3186] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:08 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:09.704871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:09.705852 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:09.712442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:09.712986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:09.713833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:09.714330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:09.859566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:09.870281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:09.872589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:09.873715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-159e97af-496b-4c27-adc4-272cccb0d855 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.173612 May 09 10:24:09.874903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1592/3187] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:09 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:10.079234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-090fbfcc-b925-4ee4-b71f-5be774ac5623 req-4048d74e-5436-4477-afe9-924e1d588cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cff08bd0-07e6-4fd9-9dba-ed7381d86652", "name": "network-vif-deleted", "tag": "75177fb9-634a-4eef-be24-15da04b57c0d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:10.088657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-090fbfcc-b925-4ee4-b71f-5be774ac5623 req-4048d74e-5436-4477-afe9-924e1d588cee service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:10.089119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-090fbfcc-b925-4ee4-b71f-5be774ac5623 req-4048d74e-5436-4477-afe9-924e1d588cee service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:10.100932 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-090fbfcc-b925-4ee4-b71f-5be774ac5623 req-4048d74e-5436-4477-afe9-924e1d588cee service nova] Creating event network-vif-deleted:75177fb9-634a-4eef-be24-15da04b57c0d for instance cff08bd0-07e6-4fd9-9dba-ed7381d86652 on hv-cinder-84108 May 09 10:24:10.106386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-090fbfcc-b925-4ee4-b71f-5be774ac5623 req-4048d74e-5436-4477-afe9-924e1d588cee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 May 09 10:24:10.107082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1596/3188] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:10.893757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:10.894353 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:10.909840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:10.910296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:10.911072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:10.911709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:11.051796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:11.060836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:11.062327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:11.063532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f080dcdd-fa06-46b2-a584-6e6d6e95437f tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.173703 May 09 10:24:11.064085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1593/3189] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:10 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:11.958147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:24:11.958749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:24:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:24:12.082860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:12.083670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:12.090797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:12.091365 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:12.092147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:12.092625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:12.122097 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-af30a6a0-af9f-4ec6-ba0e-d2f9a4b4ac07 req-0b02cf1b-99ab-4525-b294-a06243da07f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7944fa2-ab61-4f7b-b2b1-799f6cd80268", "name": "network-vif-deleted", "tag": "c89f62f3-cda6-4e2d-b4db-72ba5e09d0b8"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:12.131540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-af30a6a0-af9f-4ec6-ba0e-d2f9a4b4ac07 req-0b02cf1b-99ab-4525-b294-a06243da07f3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:12.132023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-af30a6a0-af9f-4ec6-ba0e-d2f9a4b4ac07 req-0b02cf1b-99ab-4525-b294-a06243da07f3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:12.148570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-af30a6a0-af9f-4ec6-ba0e-d2f9a4b4ac07 req-0b02cf1b-99ab-4525-b294-a06243da07f3 service nova] Creating event network-vif-deleted:c89f62f3-cda6-4e2d-b4db-72ba5e09d0b8 for instance b7944fa2-ab61-4f7b-b2b1-799f6cd80268 on hv-cinder-84108 May 09 10:24:12.154128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-af30a6a0-af9f-4ec6-ba0e-d2f9a4b4ac07 req-0b02cf1b-99ab-4525-b294-a06243da07f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035661 May 09 10:24:12.154735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1594/3190] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:12.238755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:12.247071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:12.248555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:12.249777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99056273-ec73-4cc5-a8fe-cf535971e85a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.171479 May 09 10:24:12.250344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1597/3191] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:12 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:13.268682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:13.269352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:13.276296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:13.276812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:13.277584 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:13.277991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:13.427679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:13.435836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:13.437363 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:13.438524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fe6ab643-32b0-4f4f-aab5-7598f039d4dc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.174729 May 09 10:24:13.439191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1595/3192] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:13 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:13.444190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:13.445156 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:13.451762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:13.452203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:13.453035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:13.453468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:13.482868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b4e91b45-36c6-4595-b3a1-3a70e26eb1a9 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042685 May 09 10:24:13.483428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1598/3193] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:24:13 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:24:13.493656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:13.494145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:13.500596 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:13.501074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:13.501839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:13.502264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:13.535135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7891cbb9-a5d5-40ae-877c-d09cd50a787a tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/2c4878c0-69d9-403d-89e1-8109b4bb77b0" status: 200 len: 194 microversion: 2.1 time: 0.045542 May 09 10:24:13.535729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1596/3194] 10.222.0.26 () {58 vars in 1412 bytes} [Mon May 9 10:24:13 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/2c4878c0-69d9-403d-89e1-8109b4bb77b0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:14.457804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:14.458393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:14.465578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:14.466027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:14.466808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:14.467238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:14.607647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:14.615756 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:14.617300 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:14.618473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-da803d78-ac23-4044-a77a-ded879791454 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.164844 May 09 10:24:14.619035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1599/3195] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:14 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:15.637535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:15.638181 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:15.644982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:15.645429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:15.646202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:15.646635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:15.781517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:15.789985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:15.792074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:15.793618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1e2251fc-7857-4d66-88b1-5e8b1a851314 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.159903 May 09 10:24:15.794231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1597/3196] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:15 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:16.812395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:16.813129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:16.820057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:16.820502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:16.821411 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:16.821862 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:16.956777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:16.965484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:16.967000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:16.968133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f40c9031-efe9-449c-9f57-fe0b82b429f3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.159730 May 09 10:24:16.968729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1600/3197] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:16 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:17.986991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:17.987692 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:17.994902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:17.995383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:17.996136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:17.996567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:18.019383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47562e96-7081-4852-a04f-ded2f85682f7"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:18.020481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:18.027468 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:18.027922 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:18.028760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:18.029208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:18.140940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:18.149637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:18.151122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:18.152281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-690aa524-3d91-40b7-8b4c-7a3ae7cedb27 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.169562 May 09 10:24:18.152996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1598/3198] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:17 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:19.171463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:19.172172 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:19.179310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:19.179968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:19.181229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:19.181910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:19.320124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:19.328439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:19.329956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:19.331100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d68debea-b169-4375-84d2-ae2049968bd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.163830 May 09 10:24:19.331646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1599/3199] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:19 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:20.350726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:20.351483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:20.360350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:20.360930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:20.362000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:20.362738 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:20.502518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:20.511037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:20.512298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:20.513529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29aae1a6-e2a9-4680-8478-0fd641f8b8a7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.166793 May 09 10:24:20.514083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1600/3200] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:20 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:21.530852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ad2c787-a0d9-4162-a394-45ff6ce6063c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "POST /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.515330 May 09 10:24:21.531687 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1601/3201] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:24:18 2022] POST /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments => generated 194 bytes in 3517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:21.533441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:21.534290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:21.546701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:21.547426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:21.548197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:21.548594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:21.686659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:21.694794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:21.696338 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:21.697589 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3482aa6-0de8-4f66-a648-340380896242 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.169537 May 09 10:24:21.698304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1601/3202] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:21 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:24:22.718071 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:22.718870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:22.727593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:22.727593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:22.727593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:22.727997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:22.860857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:22.869274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:22.870797 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:22.871937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-31244c04-5e92-4329-bfda-fe0c76a0deb7 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.159535 May 09 10:24:22.872491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1602/3203] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:22 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:23.890918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:23.891527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:23.898468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:23.898914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:23.899674 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:23.900102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:24.035163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:24.043658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:24.045224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:24.046380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6639f517-2b40-460e-83b3-9070df4c1869 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.159589 May 09 10:24:24.046932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1602/3204] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:23 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:25.065297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:25.065934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:25.073994 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:25.074439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:25.075235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:25.075664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:25.214036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:25.222054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:25.223590 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:25.224966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92a98b73-4c1c-486e-9fcc-6eaa2d9e6e79 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.163682 May 09 10:24:25.225522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1603/3205] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:25 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:26.243488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:26.244110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:26.250878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:26.251415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:26.252107 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:26.252538 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:26.379463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:26.387905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:26.389520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:26.390677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36496513-36c9-4c5b-b518-14f88feb8ef8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.151168 May 09 10:24:26.391207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1603/3206] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:26 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:27.409517 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:27.410143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:27.416949 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:27.417425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:27.418203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:27.418635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:27.562299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:27.572190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:27.573807 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:27.574981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-33053787-07b1-40f2-b828-0f4a72daaf65 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.169433 May 09 10:24:27.575520 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1604/3207] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:27 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:28.593109 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:28.593724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:28.600191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:28.600638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:28.601430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:28.601862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:28.741489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:28.749440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:28.750957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:28.752127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3dcd215d-3dd3-4522-8870-53dfdaf5f072 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.162922 May 09 10:24:28.752675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1604/3208] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:28 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:29.771617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:29.772376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:29.779465 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:29.779923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:29.780743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:29.781183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:29.925347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:29.934380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:29.936082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:29.937323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c48c15d9-5ccb-40a2-b4b9-4f587bf7c3ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1744 microversion: 2.20 time: 0.169698 May 09 10:24:29.937887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1605/3209] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:29 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:30.100305 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:30.101362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:30.107956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.108404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.109206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.109615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.139211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f006d2aa-79db-49e9-afc6-e068be0882f1 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042807 May 09 10:24:30.139767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1605/3210] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:24:30 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:30.298304 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:30.298824 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:30.305528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.306026 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.306810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.307235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.338191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bf831582-708e-41f0-bcb4-20a8ad27b4d0 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/2c4878c0-69d9-403d-89e1-8109b4bb77b0" status: 200 len: 194 microversion: 2.1 time: 0.043425 May 09 10:24:30.341679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1606/3211] 10.222.0.26 () {58 vars in 1412 bytes} [Mon May 9 10:24:30 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/2c4878c0-69d9-403d-89e1-8109b4bb77b0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:30.348019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:30.348672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:30.355007 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.355461 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.356248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.356695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.439736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lazy-loading 'services' on Instance uuid ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:24:30.515580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b3ea509d-bbd5-468b-ae79-ecfc0529eebc tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/2c4878c0-69d9-403d-89e1-8109b4bb77b0" status: 202 len: 0 microversion: 2.1 time: 0.171419 May 09 10:24:30.516311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1606/3212] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:24:30 2022] DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/2c4878c0-69d9-403d-89e1-8109b4bb77b0 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:24:30.956967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:30.957555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:30.964582 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.965057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:30.965849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:30.966294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:31.099878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:31.109099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:31.110643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:31.112392 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6d80f5a3-70da-4942-ac37-5fe19d9fc6f1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1744 microversion: 2.20 time: 0.159161 May 09 10:24:31.113072 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1607/3213] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:30 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:32.134571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:32.135213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:32.141571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.142017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.142832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.143261 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.280211 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:32.288873 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:32.290425 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:32.291650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-412d4492-235f-4b65-ad21-b21e8436d470 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1744 microversion: 2.20 time: 0.162143 May 09 10:24:32.292259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1607/3214] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:32 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:24:32.630521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-9ec2770f-6f6b-4d13-bb0c-714e58a41788 req-98af2373-3d78-4353-86c7-fb58352c6532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "name": "network-vif-plugged", "status": "completed", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:32.638784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9ec2770f-6f6b-4d13-bb0c-714e58a41788 req-98af2373-3d78-4353-86c7-fb58352c6532 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.639218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-9ec2770f-6f6b-4d13-bb0c-714e58a41788 req-98af2373-3d78-4353-86c7-fb58352c6532 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.650516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-9ec2770f-6f6b-4d13-bb0c-714e58a41788 req-98af2373-3d78-4353-86c7-fb58352c6532 service nova] Creating event network-vif-plugged:001daf04-3f69-4af0-b1cf-e0ed36819de0 for instance 0e923da8-ef54-4364-a345-eb053850f0e6 on hv-cinder-84108 May 09 10:24:32.655921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-9ec2770f-6f6b-4d13-bb0c-714e58a41788 req-98af2373-3d78-4353-86c7-fb58352c6532 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154082 May 09 10:24:32.656773 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1608/3215] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:24:32.686683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:32.687166 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:32.693387 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.693830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.694604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.695029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.723614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d22aa50-5c5e-4842-b26e-1b281ff02866 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/47562e96-7081-4852-a04f-ded2f85682f7" status: 200 len: 194 microversion: 2.1 time: 0.041165 May 09 10:24:32.724246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1608/3216] 10.222.0.26 () {58 vars in 1412 bytes} [Mon May 9 10:24:32 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/47562e96-7081-4852-a04f-ded2f85682f7 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:24:32.734799 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:32.735406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:32.742097 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.742543 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.743306 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:32.743738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:32.825970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lazy-loading 'services' on Instance uuid ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:24:32.899820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-92abcd83-5519-4122-90d7-e9ea79cc912f tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/47562e96-7081-4852-a04f-ded2f85682f7" status: 202 len: 0 microversion: 2.1 time: 0.169138 May 09 10:24:32.900367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1609/3217] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:24:32 2022] DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments/47562e96-7081-4852-a04f-ded2f85682f7 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:24:33.310547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:33.311140 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:33.317610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:33.318054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:33.319062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:33.319713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:33.498415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:33.506581 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:33.508108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:33.509308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3019c708-e167-4e57-a70e-a9308744bdfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1744 microversion: 2.20 time: 0.202740 May 09 10:24:33.509849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1609/3218] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:33 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:24:34.065100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:34.066129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:34.073068 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.073518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.074287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.074721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.104477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8d54e7d5-e386-4cfb-a51e-d9e1db9e4446 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043756 May 09 10:24:34.105077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1610/3219] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:24:34 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 10:24:34.222103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:34.222940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:34.229340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.229788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.230553 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.230982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.263062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bbb0c791-7ff2-4602-b76a-a9e14d72d556 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044934 May 09 10:24:34.263629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1610/3220] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:24:34 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 10:24:34.322551 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:34.323039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:34.329467 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.329920 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.330682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.331115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.356941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:24:34.438326 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d942f0cf-341d-4416-af85-f1a171b36f0e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 204 len: 0 microversion: 2.1 time: 0.119396 May 09 10:24:34.438983 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1611/3221] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:24:34 2022] DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:24:34.447527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:34.448136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:34.454746 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.455192 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.455963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.456402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.529384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:34.529989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:34.536302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.536783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.537842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:34.538480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:34.597147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:34.604915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d4529013-51df-4318-b48e-5ab59927a560 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1675 microversion: 2.1 time: 0.161300 May 09 10:24:34.605499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1611/3222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:24:34 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:24:34.671602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:34.680119 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:34.681650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:34.682812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d1e9c738-3733-44f6-8ea4-c49e2a381810 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1744 microversion: 2.20 time: 0.158201 May 09 10:24:34.683428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1612/3223] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:34 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:35.623963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:35.625038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:35.631726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:35.632169 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:35.632978 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:35.633407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:35.708065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:35.708841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:35.716527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:35.717094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:35.718135 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:35.718918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:35.813610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:35.823228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f06fc94f-fdb2-4b15-9044-2c4b1bc1b83e tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1675 microversion: 2.1 time: 0.203650 May 09 10:24:35.824226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1612/3224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:24:35 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:24:35.886871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:35.895512 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:35.897761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:35.899215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6b3e1f78-7ae0-4374-8901-70959ca994d3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.201735 May 09 10:24:35.899779 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1613/3225] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:35 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:36.842661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:36.843322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:36.849941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:36.851012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:36.852022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:36.852631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:36.920361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f89c5ab1020947a9bece03af4c237480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c90b9a64e6a8464b9cde8bb967c4872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:36.920742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:36.922170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:36.931367 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d8c0f2ea-dd13-46da-b07e-c9a151078a43 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 200 len: 1607 microversion: 2.1 time: 0.094408 May 09 10:24:36.932531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1613/3226] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:24:36 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 1607 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:24:36.934854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:36.935299 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:36.936080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:36.936516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:37.096414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-bc0e549c-1c13-4d10-a5d7-b5884a669a21 req-22fce347-3e48-4e61-b23f-32451a29887e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc", "name": "network-vif-deleted", "tag": "21b1ea04-b927-4b84-a601-56c6f8deccfb"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:37.110249 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-bc0e549c-1c13-4d10-a5d7-b5884a669a21 req-22fce347-3e48-4e61-b23f-32451a29887e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:37.110704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-bc0e549c-1c13-4d10-a5d7-b5884a669a21 req-22fce347-3e48-4e61-b23f-32451a29887e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:37.156749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-bc0e549c-1c13-4d10-a5d7-b5884a669a21 req-22fce347-3e48-4e61-b23f-32451a29887e service nova] Creating event network-vif-deleted:21b1ea04-b927-4b84-a601-56c6f8deccfb for instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc on hv-cinder-84108 May 09 10:24:37.174697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-bc0e549c-1c13-4d10-a5d7-b5884a669a21 req-22fce347-3e48-4e61-b23f-32451a29887e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085150 May 09 10:24:37.175599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1614/3227] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:24:37.260956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:37.282335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:37.288041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:37.291774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27d00a9b-bcec-48d0-950e-70107130a1ec tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.376351 May 09 10:24:37.292750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1614/3228] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:36 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 09 10:24:37.951834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:37.952532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:37.963231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:37.964089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:37.965037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:37.966030 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:37.991142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] HTTP exception thrown: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Request method failure captured: May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc HTTP/1.1 May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMxbq93QN8ACki62iZj2eNuN_KUtngl9Glu8EdPyIST1ARE5W3mI515Lee6J5i54j0ByXnuaL2pvFYpY3dZvz8c6m6LmWI8wQJqq6uQlq6Ut-6GN_ugBfuK7dyOXcZtbwAnDbrzw1fwQC6IpDc0zFy8oEbjcKjagTOHVtnNHtmV14c May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:24:37.993514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c90b9a64e6a8464b9cde8bb967c4872d", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: f89c5ab1020947a9bece03af4c237480 May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:37.995188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc'} May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:24:37.996245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:37.997857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:38.001333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Returning 404 to user: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:24:38.002682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5513642-f16a-4bde-aa59-98bd54fc5123 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 404 len: 111 microversion: 2.1 time: 0.056130 May 09 10:24:38.003660 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1615/3229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:24:37 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:24:38.015836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3293257d-e51b-45e2-a33b-922fdb166b0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '.version_select at 0x7fa467ea8310>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:38.059554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3293257d-e51b-45e2-a33b-922fdb166b0c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017090006" status: 202 len: 0 microversion: 2.1 time: 0.049142 May 09 10:24:38.060492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1615/3230] 10.222.0.26 () {58 vars in 1220 bytes} [Mon May 9 10:24:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017090006 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:24:38.313679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:38.314218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:38.323766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:38.324195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:38.326114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:38.326752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:38.593621 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:38.609586 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:38.612792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:38.614406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-238d8708-b555-41e7-bac2-14e138f03b3a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.306654 May 09 10:24:38.625432 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1616/3231] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:38 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:39.633609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:39.634926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:39.642115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:39.642566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:39.643679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:39.644129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:39.807159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:39.816453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:39.818023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:39.819197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70f6b52c-3f0b-44f4-b1d7-ff80d3c47ea6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.189869 May 09 10:24:39.819766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1616/3232] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:39 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:40.838546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:40.839260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:40.846014 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:40.846709 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:40.847737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:40.848341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:41.020371 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:41.030592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:41.036091 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:41.043197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5da8add5-041e-40e6-beac-af95146b1808 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.203802 May 09 10:24:41.054900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1617/3233] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:40 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:41.307707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:41.308720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:41.319927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:41.320726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:41.322092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:41.322845 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:41.343916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] HTTP exception thrown: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Request method failure captured: May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc HTTP/1.1 May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMxbq93QN8ACki62iZj2eNuN_KUtngl9Glu8EdPyIST1ARE5W3mI515Lee6J5i54j0ByXnuaL2pvFYpY3dZvz8c6m6LmWI8wQJqq6uQlq6Ut-6GN_ugBfuK7dyOXcZtbwAnDbrzw1fwQC6IpDc0zFy8oEbjcKjagTOHVtnNHtmV14c May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:24:41.345985 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c90b9a64e6a8464b9cde8bb967c4872d", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: f89c5ab1020947a9bece03af4c237480 May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.347806 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc'} May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:24:41.348911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.350607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:41.353178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Returning 404 to user: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:24:41.354536 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-70d4f5b4-a4e7-4b0b-9614-2961e791fd3c tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 404 len: 111 microversion: 2.1 time: 0.053624 May 09 10:24:41.355123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1617/3234] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:24:41 2022] DELETE /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:24:41.363796 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:41.364492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:41.371383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:41.371833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:41.372622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:41.373122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:41.394220 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] HTTP exception thrown: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Request method failure captured: May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc HTTP/1.1 May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMxbq93QN8ACki62iZj2eNuN_KUtngl9Glu8EdPyIST1ARE5W3mI515Lee6J5i54j0ByXnuaL2pvFYpY3dZvz8c6m6LmWI8wQJqq6uQlq6Ut-6GN_ugBfuK7dyOXcZtbwAnDbrzw1fwQC6IpDc0zFy8oEbjcKjagTOHVtnNHtmV14c May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:24:41.395981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c90b9a64e6a8464b9cde8bb967c4872d", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: f89c5ab1020947a9bece03af4c237480 May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.397832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc'} May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:24:41.398887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. May 09 10:24:41.400558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:41.403016 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Returning 404 to user: Instance ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:24:41.403886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bc10bd3f-2596-4216-b9ed-a579f67667de tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc" status: 404 len: 111 microversion: 2.1 time: 0.044246 May 09 10:24:41.404476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1618/3235] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:24:41 2022] GET /compute/v2.1/servers/ff5a7bc7-b54f-41dc-bd9e-8fed41c60fcc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 10:24:42.065878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:42.067224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:42.076144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:42.076901 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:42.077909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:42.078550 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:42.221529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:42.229742 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:42.231229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:42.232383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cfa84a67-3e36-4919-b1ef-1dd22c714219 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.173488 May 09 10:24:42.232969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1618/3236] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:42 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:42.576916 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:42.578791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:42.588699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:42.589424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:42.590295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:42.590800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:42.606405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] HTTP exception thrown: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Request method failure captured: May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a HTTP/1.1 May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMxbq93QN8ACki62iZj2eNuN_KUtngl9Glu8EdPyIST1ARE5W3mI515Lee6J5i54j0ByXnuaL2pvFYpY3dZvz8c6m6LmWI8wQJqq6uQlq6Ut-6GN_ugBfuK7dyOXcZtbwAnDbrzw1fwQC6IpDc0zFy8oEbjcKjagTOHVtnNHtmV14c May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:24:42.609102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c90b9a64e6a8464b9cde8bb967c4872d", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: f89c5ab1020947a9bece03af4c237480 May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.610726 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '3383afcd-c1f1-4a06-b1e3-3bd49e32744a'} May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:24:42.611636 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.613117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:24:42.614677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Returning 404 to user: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:24:42.614677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7ac7041-c505-47af-9e0f-e7719f64b4cf tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 404 len: 111 microversion: 2.1 time: 0.039265 May 09 10:24:42.614677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1619/3237] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:24:42 2022] DELETE /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:24:42.621413 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:42.622331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] [instance: 3383afcd-c1f1-4a06-b1e3-3bd49e32744a] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:42.629066 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:42.629518 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:42.630483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:42.630918 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:42.647734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] HTTP exception thrown: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Request method failure captured: May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a HTTP/1.1 May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMxbq93QN8ACki62iZj2eNuN_KUtngl9Glu8EdPyIST1ARE5W3mI515Lee6J5i54j0ByXnuaL2pvFYpY3dZvz8c6m6LmWI8wQJqq6uQlq6Ut-6GN_ugBfuK7dyOXcZtbwAnDbrzw1fwQC6IpDc0zFy8oEbjcKjagTOHVtnNHtmV14c May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:24:42.649296 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c90b9a64e6a8464b9cde8bb967c4872d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c90b9a64e6a8464b9cde8bb967c4872d", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: c90b9a64e6a8464b9cde8bb967c4872d May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-375827953 May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: f89c5ab1020947a9bece03af4c237480 May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeTestJSON-375827953-project May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.651124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '3383afcd-c1f1-4a06-b1e3-3bd49e32744a'} May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:24:42.652165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. May 09 10:24:42.653905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:24:42.655717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] Returning 404 to user: Instance 3383afcd-c1f1-4a06-b1e3-3bd49e32744a could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:24:42.655717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bcfa73c6-2df6-4f34-87b6-7cb859559292 tempest-AttachVolumeTestJSON-375827953 tempest-AttachVolumeTestJSON-375827953-project] 10.222.0.26 "GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a" status: 404 len: 111 microversion: 2.1 time: 0.034108 May 09 10:24:42.655717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1619/3238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:24:42 2022] GET /compute/v2.1/servers/3383afcd-c1f1-4a06-b1e3-3bd49e32744a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:24:43.250566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:43.251173 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:43.259723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:43.260748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:43.261987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:43.263008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:43.455780 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:43.464769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:43.466569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:43.467876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8ec9ee3f-de32-4ea0-b037-418d8440c200 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.221262 May 09 10:24:43.479187 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1620/3239] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:43 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:44.489538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:44.490151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:44.499959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:44.500415 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:44.501253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:44.504965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:45.002101 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:45.010992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:45.012771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:45.014067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7125b992-4e97-4bdf-ab36-16e06b164734 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.530767 May 09 10:24:45.014632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1620/3240] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:44 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:46.035509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:46.036163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:46.042574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:46.043015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:46.043766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:46.044193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:46.265312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:46.274791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:46.276756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:46.278096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4137f116-764b-497a-a4cf-2bd12cf7d43e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1739 microversion: 2.20 time: 0.246606 May 09 10:24:46.279244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1621/3241] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:46 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:47.296951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:47.297752 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:47.304257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:47.304743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:47.305489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:47.306163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:47.442691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:47.450735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:47.452388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:47.453646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-08e150d6-21eb-409a-b530-2bd2b7778451 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1721 microversion: 2.20 time: 0.160716 May 09 10:24:47.454318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1621/3242] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:47 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:48.477643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:48.491093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:48.503964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:48.503964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:48.503964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:48.503964 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:48.653059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:48.662490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:48.663982 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:48.665174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e7cdfe06-18cc-4dfe-be1c-e509d14d4240 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1664 microversion: 2.20 time: 0.195319 May 09 10:24:48.666131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1622/3243] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:48 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:48.683719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0069b83-3166-4cdc-a52b-a4b10ad56e70"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:48.685505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:48.693115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:48.697309 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:48.698154 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:48.698583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:48.996892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eb34651e-e764-46f7-abfa-e4390f51a8d1 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313360 May 09 10:24:48.997553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1622/3244] 10.222.0.26 () {62 vars in 1363 bytes} [Mon May 9 10:24:48 2022] POST /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 09 10:24:49.114690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:49.115195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:49.121303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:49.121888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:49.122535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:49.122967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:49.396028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8c5154d4-4bc8-450a-acad-f37006f657ae tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-volume_attachments/a0069b83-3166-4cdc-a52b-a4b10ad56e70" status: 202 len: 0 microversion: 2.20 time: 0.285342 May 09 10:24:49.396993 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1623/3245] 10.222.0.26 () {60 vars in 1456 bytes} [Mon May 9 10:24:49 2022] DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-volume_attachments/a0069b83-3166-4cdc-a52b-a4b10ad56e70 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 09 10:24:49.454642 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:49.455207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:49.461540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:49.462060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:49.462874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:49.463313 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:49.735836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-68a6941c-8bcd-4f23-af10-3a4efcde8f6d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "POST /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/action" status: 202 len: 0 microversion: 2.20 time: 0.285017 May 09 10:24:49.737218 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1623/3246] 10.222.0.26 () {62 vars in 1318 bytes} [Mon May 9 10:24:49 2022] POST /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 09 10:24:49.749573 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:49.750189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:49.757467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:49.757918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:49.758700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:49.759139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:49.928790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:49.940831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:49.942901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:49.944275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5321ece8-8734-4588-a32f-304e204b83a9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1672 microversion: 2.20 time: 0.198745 May 09 10:24:49.945288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1624/3247] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:49 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:50.812766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-90b6bd14-755d-4f6f-8adf-4a2f9bbad0ad req-2b2f1182-520b-443d-8ed7-e96c7810485e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "name": "network-vif-unplugged", "status": "completed", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:24:50.827646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-90b6bd14-755d-4f6f-8adf-4a2f9bbad0ad req-2b2f1182-520b-443d-8ed7-e96c7810485e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:50.828464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-90b6bd14-755d-4f6f-8adf-4a2f9bbad0ad req-2b2f1182-520b-443d-8ed7-e96c7810485e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:50.842541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.compute.server_external_events [req-90b6bd14-755d-4f6f-8adf-4a2f9bbad0ad req-2b2f1182-520b-443d-8ed7-e96c7810485e service nova] Unable to find a host for instance 0e923da8-ef54-4364-a345-eb053850f0e6. Dropping event network-vif-unplugged {{(pid=123637) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 10:24:50.843412 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-90b6bd14-755d-4f6f-8adf-4a2f9bbad0ad req-2b2f1182-520b-443d-8ed7-e96c7810485e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036959 May 09 10:24:50.844319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1624/3248] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 09 10:24:50.964473 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:50.965364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:50.972408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:50.972939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:50.973895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:50.974331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:51.121918 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:51.130086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:51.132095 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:51.132784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-069db40a-683c-4d17-acf8-bd1ea79e9377 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.173502 May 09 10:24:51.134002 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1625/3249] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:50 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:52.159709 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:52.162401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:52.173510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:52.173962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:52.174881 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:52.175317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:52.325458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:52.336176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:52.338616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:52.340604 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3cc57af2-25af-4cf1-84ba-24c3ccd70ca8 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.189576 May 09 10:24:52.353743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1625/3250] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:52 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:53.359853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:53.360458 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:53.367303 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:53.367719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:53.368475 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:53.369123 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:53.523844 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:53.533599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:53.535792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:53.537276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-985d9571-7b2d-4275-9193-674d9620fa12 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.181346 May 09 10:24:53.548885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1626/3251] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:53 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:54.558047 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:54.559567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:54.568208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:54.569227 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:54.570289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:54.570944 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:54.760387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:54.774909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:54.776801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:54.778210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eca8b67c-65cc-4830-8c8d-4fdf7a06c45e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.226038 May 09 10:24:54.789583 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1626/3252] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:54 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:55.798276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:55.800936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:55.808142 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:55.809233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:55.810207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:55.810754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:55.991723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:55.999652 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:56.001255 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:56.002539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a8325570-927d-40b8-9c0d-f3fb73d6b073 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.208704 May 09 10:24:56.003162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1627/3253] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:55 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:57.026846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:57.029939 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:57.043766 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:57.046057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:57.046898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:57.047335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:57.212808 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:57.221222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:57.222743 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:57.224104 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7613e8e-93d7-4360-81f7-ee42de89a8d6 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.204447 May 09 10:24:57.224683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1627/3254] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:57 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:58.241848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:58.242574 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:58.249767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:58.250316 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:58.251113 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:58.251777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:58.437729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:58.461587 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:58.463628 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:58.466515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-29869e9c-f208-45e9-a5e5-5c2ab5dcc13e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.228608 May 09 10:24:58.480093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1628/3255] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:58 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:24:59.292903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:24:59.293632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:24:59.489328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:24:59.489924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:24:59.496850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:59.497266 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:59.498289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:24:59.498714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:24:59.655061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:59.664403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:59.666045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:24:59.667431 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fae6e894-1e1f-4beb-89c2-7b599e886b1c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.183532 May 09 10:24:59.668093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1628/3256] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:24:59 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:00.687495 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:00.688121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:00.695737 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:00.696707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:00.697351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:00.697958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:00.895329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:00.905094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:00.906743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:00.907985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-bf485f9c-fd5d-4807-8020-8d5abce99bc2 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.224626 May 09 10:25:00.908622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1629/3257] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:00 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:01.930948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:01.932039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:01.942286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:01.942735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:01.943505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:01.943936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:02.082831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:02.091114 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:02.092598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:02.093784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-085e3190-1918-4570-8df8-947eceeb7e29 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.169647 May 09 10:25:02.094480 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1629/3258] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:01 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:03.113847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:03.114481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:03.121210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:03.121650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:03.122417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:03.122820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:03.257083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:03.265976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:03.267515 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:03.268698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d0ad73c0-4d10-49cc-a487-6ba88c408812 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.159046 May 09 10:25:03.269270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1630/3259] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:03 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:04.288513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:04.289150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:04.295618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:04.296178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:04.296986 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:04.297424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:04.442683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:04.453238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:04.455203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:04.457060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b2d909f4-af9a-4ad1-b446-62b38d94e279 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.172550 May 09 10:25:04.457805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1630/3260] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:04 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:05.476430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:05.477278 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:05.484593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:05.485055 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:05.486068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:05.486500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:05.625017 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:05.633328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:05.634834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:05.635996 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-58792473-c76f-4b1f-b49d-1fb0cce2308a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.164283 May 09 10:25:05.636534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1631/3261] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:05 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:06.655080 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:06.655735 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:06.662859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:06.663277 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:06.664054 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:06.664491 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:06.815728 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:06.825143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:06.826625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:06.827820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-07f7f20f-869f-4d8a-a318-faad40946e76 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.176771 May 09 10:25:06.828405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1631/3262] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:06 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:07.847981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:07.848599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:07.855159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:07.855597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:07.856362 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:07.856812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:07.988372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:08.000288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:08.002671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:08.004074 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-36c7fede-5525-40c5-8011-c3b5aab4806d tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.160388 May 09 10:25:08.004711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1632/3263] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:07 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:09.212489 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:09.213089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:09.220016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:09.220438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:09.221247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:09.221684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:09.466844 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:09.475148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:09.476684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:09.477819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-11c6c281-e5c9-4db2-aa4a-beed194e180a tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.457648 May 09 10:25:09.478380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1632/3264] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:09 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:10.503923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:10.504614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:10.512259 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:10.512801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:10.513653 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:10.514121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:10.716971 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:10.725701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:10.727229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:10.728372 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-879087fc-39c8-4a5c-8411-39b32398cc52 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.228848 May 09 10:25:10.728975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1633/3265] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:10 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:11.750502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:11.751149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:11.758761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:11.759207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:11.759964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:11.760393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:11.908378 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:11.916719 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:11.918228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:11.919373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1f2dbbd8-086e-4473-9c1f-5ba811cdfeb9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.172883 May 09 10:25:11.919913 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1633/3266] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:11 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:12.946324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:12.946938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:12.956777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:12.957226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:12.957998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:12.958430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:13.090864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:13.099482 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:13.100998 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:13.102148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3a165eb8-fed2-4837-be9a-5cd07634bcf3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.162391 May 09 10:25:13.102723 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1634/3267] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:12 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:14.124418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:14.125103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:14.132209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:14.132688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:14.133464 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:14.133902 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:14.264462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:14.273302 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:14.274801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:14.275963 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4ae822a7-3011-4dbb-bb61-2f1d1760b897 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.155560 May 09 10:25:14.276531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1634/3268] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:14 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:15.295202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:15.295924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:15.303287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:15.303763 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:15.304516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:15.304976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:15.449435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:15.457696 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:15.459494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:15.460650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-334e1675-e386-4caf-b577-e77d4770cfd0 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.169907 May 09 10:25:15.461239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1635/3269] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:15 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:16.478962 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:16.479553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:16.486000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:16.486452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:16.487224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:16.487695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:16.681965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:16.690423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:16.692143 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:16.693646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cec2044c-2108-4ab0-9a33-71ea6fb8da31 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.219170 May 09 10:25:16.694369 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1635/3270] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:16 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:17.713536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:17.714189 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:17.720790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:17.721245 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:17.722170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:17.722599 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:17.861029 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:17.869163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:17.870671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:17.872133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-224a3e6b-6a73-49b9-a9ce-1ab0e67a8c69 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.162654 May 09 10:25:17.872793 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1636/3271] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:17 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:18.772731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-a4ab8fc5-453a-4eec-89d0-e107924b3725 req-28a369b7-773c-4617-8aab-8b72d3c366f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "name": "network-vif-plugged", "status": "completed", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:25:18.782426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-a4ab8fc5-453a-4eec-89d0-e107924b3725 req-28a369b7-773c-4617-8aab-8b72d3c366f7 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:18.782899 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-a4ab8fc5-453a-4eec-89d0-e107924b3725 req-28a369b7-773c-4617-8aab-8b72d3c366f7 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:18.794498 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-a4ab8fc5-453a-4eec-89d0-e107924b3725 req-28a369b7-773c-4617-8aab-8b72d3c366f7 service nova] Creating event network-vif-plugged:001daf04-3f69-4af0-b1cf-e0ed36819de0 for instance 0e923da8-ef54-4364-a345-eb053850f0e6 on hv-cinder-84108 May 09 10:25:18.800854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-a4ab8fc5-453a-4eec-89d0-e107924b3725 req-28a369b7-773c-4617-8aab-8b72d3c366f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032740 May 09 10:25:18.801666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1636/3272] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:25:18.892655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:18.893748 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:18.901965 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:18.902520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:18.903358 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:18.903863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:19.089644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:19.099296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:19.101043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:19.102346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eee1cbb7-ef02-43a5-827e-eec33ea71381 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.214653 May 09 10:25:19.103184 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1637/3273] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:18 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:20.126057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:20.126774 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:20.133802 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:20.134249 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:20.135167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:20.135488 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:20.296781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:20.304722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:20.306244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:20.307402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-827c4d39-3ac3-4aa0-a745-6f5da7003227 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1730 microversion: 2.20 time: 0.188743 May 09 10:25:20.307948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1637/3274] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:20 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:25:21.325689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:25:21.326308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:25:21.332849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:21.333623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:21.334393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:25:21.334789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:25:21.469094 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:21.477791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:21.479277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:25:21.480426 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3343227b-1230-4047-ab61-05235f1fdab9 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1717 microversion: 2.20 time: 0.158671 May 09 10:25:21.481213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1638/3275] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:25:21 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1717 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:26:03.216769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1505955252", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:03.288732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] validate_networks() for None {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:26:03.564650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:26:03.565094 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:26:03.565566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:26:03.565965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:26:03.566571 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:26:03.578871 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:03.579563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:03.580820 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:03.581510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:03.603670 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Getting quotas for project 88319789c26e4c7eb549e2e7e70093ee. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:26:03.607795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Getting quotas for user cc05a8b1491f4555aa6574cd0904555d and project 88319789c26e4c7eb549e2e7e70093ee. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:26:03.619125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:26:03.621595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:26:03.668030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63e1cf53-8dbb-40f4-a5a6-e4e420cff0f1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454856 May 09 10:26:03.668620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1638/3276] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:26:03.678992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6b85a0b5-a3ad-45eb-8005-069a9b13869d tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:03.679594 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6b85a0b5-a3ad-45eb-8005-069a9b13869d tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:03.732907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6b85a0b5-a3ad-45eb-8005-069a9b13869d tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:03.739514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6b85a0b5-a3ad-45eb-8005-069a9b13869d tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1215 microversion: 2.1 time: 0.064563 May 09 10:26:03.740081 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1639/3277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:03 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:04.755814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:04.756439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:04.766782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:04.767264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:04.768060 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:04.768495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:04.836438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:04.844809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b1de1309-5255-40f4-af35-81b77b1198ce tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1285 microversion: 2.1 time: 0.093001 May 09 10:26:04.845402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1639/3278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:04 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:05.863799 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:05.864484 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:05.872110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:05.872555 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:05.873352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:05.873892 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:06.079731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:06.088058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-102a938e-bd56-4afb-91c0-36cf7e0e162a tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.229185 May 09 10:26:06.088728 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1640/3279] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:05 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:06.876269 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-f5d1b047-5774-43c0-8dff-2b8ed737c8bc req-333d33b3-1440-4cd9-9b40-30873f37588d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e243da-3288-491a-8046-adf9af156dbe", "tag": "478bf16c-2b0e-43ec-8a9f-68b2afd68b28"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:06.885100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f5d1b047-5774-43c0-8dff-2b8ed737c8bc req-333d33b3-1440-4cd9-9b40-30873f37588d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:06.885693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f5d1b047-5774-43c0-8dff-2b8ed737c8bc req-333d33b3-1440-4cd9-9b40-30873f37588d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:06.897805 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-f5d1b047-5774-43c0-8dff-2b8ed737c8bc req-333d33b3-1440-4cd9-9b40-30873f37588d service nova] Creating event network-changed:478bf16c-2b0e-43ec-8a9f-68b2afd68b28 for instance 80e243da-3288-491a-8046-adf9af156dbe on hv-cinder-84108 May 09 10:26:06.903078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-f5d1b047-5774-43c0-8dff-2b8ed737c8bc req-333d33b3-1440-4cd9-9b40-30873f37588d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196557 May 09 10:26:06.903714 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1640/3280] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:26:07.105459 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:07.106084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:07.112944 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:07.113369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:07.114167 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:07.114577 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:07.261562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:07.269083 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9f9c45b-d59b-4db8-84bf-15a1f3a18b20 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.167547 May 09 10:26:07.269641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1641/3281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:07 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:08.287086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:08.287749 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:08.294519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:08.294972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:08.295729 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:08.296184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:08.435172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:08.446210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a9d3bdd-8191-455e-aa47-9f948e3fe6e1 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.163726 May 09 10:26:08.446992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1641/3282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:08 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:09.467059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:09.467703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:09.474756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:09.475280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:09.476119 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:09.476641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:09.697056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:09.706408 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3d2417ff-fac8-4c19-8656-a215556185bf tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.243791 May 09 10:26:09.706989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1642/3283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:09 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:10.725581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:10.726386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:10.735193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:10.735644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:10.736406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:10.736874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:10.866952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:10.878409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-10fe3a39-2bf6-40d0-938d-988303cd23ae tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.158158 May 09 10:26:10.879569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1642/3284] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:10 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:11.905324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:11.905941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:11.912820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:11.913268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:11.914023 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:11.914455 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:12.042666 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:12.051068 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3ac825b1-7bd6-4020-ad44-ff60cb402590 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.152316 May 09 10:26:12.051626 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1643/3285] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:11 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:13.002989 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-b1c302fb-be93-46a8-bcfe-dda0f5b6b775 req-68113f84-5108-4bce-9c8b-6e203222f2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e243da-3288-491a-8046-adf9af156dbe", "name": "network-vif-plugged", "status": "completed", "tag": "478bf16c-2b0e-43ec-8a9f-68b2afd68b28"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:13.011997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b1c302fb-be93-46a8-bcfe-dda0f5b6b775 req-68113f84-5108-4bce-9c8b-6e203222f2ed service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:13.012796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b1c302fb-be93-46a8-bcfe-dda0f5b6b775 req-68113f84-5108-4bce-9c8b-6e203222f2ed service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:13.026177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-b1c302fb-be93-46a8-bcfe-dda0f5b6b775 req-68113f84-5108-4bce-9c8b-6e203222f2ed service nova] Creating event network-vif-plugged:478bf16c-2b0e-43ec-8a9f-68b2afd68b28 for instance 80e243da-3288-491a-8046-adf9af156dbe on hv-cinder-84108 May 09 10:26:13.031373 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-b1c302fb-be93-46a8-bcfe-dda0f5b6b775 req-68113f84-5108-4bce-9c8b-6e203222f2ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 May 09 10:26:13.032011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1643/3286] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:26:13.067806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:13.068411 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:13.075054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:13.075494 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:13.076341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:13.076797 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:13.224620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:13.232571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b01189ce-0b55-4e1e-b25a-dce8deadbd79 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.168926 May 09 10:26:13.233269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1644/3287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:13 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:14.253497 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:14.254399 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:14.264204 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:14.264880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:14.266130 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:14.266545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:14.407685 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:14.419569 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dc10cbcd-7897-4621-a612-90c8743e576e tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1315 microversion: 2.1 time: 0.172016 May 09 10:26:14.420383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1644/3288] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:14 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:15.438407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:15.439039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:15.446295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:15.446754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:15.447516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:15.447949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:15.593227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:15.601326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-571af146-c75f-4111-8c6a-93993523c9a7 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1465 microversion: 2.1 time: 0.167368 May 09 10:26:15.601902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1645/3289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:15 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:15.641086 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:15.641652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:15.650254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:15.651033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:15.652288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:15.653128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:15.680159 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:26:15.763684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5f63eeb6-43fe-472e-809b-57bb280f87aa tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "DELETE /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 204 len: 0 microversion: 2.1 time: 0.125984 May 09 10:26:15.764393 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1645/3290] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:26:15 2022] DELETE /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:26:15.773193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:15.773805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:15.780735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:15.781217 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:15.781991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:15.782418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:15.915924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:15.923542 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7cb60b4e-13ed-43fd-8152-497cdae10486 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1471 microversion: 2.1 time: 0.154263 May 09 10:26:15.924110 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1646/3291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:15 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:16.944581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:16.945308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:16.952031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:16.952473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:16.953297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:16.953716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:17.085574 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:17.093265 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4eecb521-f2be-4d05-817f-bb3337c13f3c tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1471 microversion: 2.1 time: 0.152708 May 09 10:26:17.093671 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1646/3292] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:16 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:17.884519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-b28cd96d-672a-4166-956c-12114936fdce req-39d093ea-af80-4a1f-9fa8-6043a285419f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e243da-3288-491a-8046-adf9af156dbe", "name": "network-vif-deleted", "tag": "478bf16c-2b0e-43ec-8a9f-68b2afd68b28"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:17.895288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b28cd96d-672a-4166-956c-12114936fdce req-39d093ea-af80-4a1f-9fa8-6043a285419f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:17.895718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b28cd96d-672a-4166-956c-12114936fdce req-39d093ea-af80-4a1f-9fa8-6043a285419f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:17.908481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-b28cd96d-672a-4166-956c-12114936fdce req-39d093ea-af80-4a1f-9fa8-6043a285419f service nova] Creating event network-vif-deleted:478bf16c-2b0e-43ec-8a9f-68b2afd68b28 for instance 80e243da-3288-491a-8046-adf9af156dbe on hv-cinder-84108 May 09 10:26:17.914183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-b28cd96d-672a-4166-956c-12114936fdce req-39d093ea-af80-4a1f-9fa8-6043a285419f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 May 09 10:26:17.914807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1647/3293] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:26:18.111679 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:18.112276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:18.118831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:18.119345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:18.120023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:18.120479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:18.153031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:18.153521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:18.153973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lazy-loading 'fault' on Instance uuid 80e243da-3288-491a-8046-adf9af156dbe {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:26:18.194859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc05a8b1491f4555aa6574cd0904555d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88319789c26e4c7eb549e2e7e70093ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:18.202866 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5b3ee98d-31cb-4832-82d9-e685731a9a4f tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 200 len: 1305 microversion: 2.1 time: 0.096897 May 09 10:26:18.203473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1647/3294] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:18 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:26:19.227100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:19.227805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] [instance: 80e243da-3288-491a-8046-adf9af156dbe] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:19.234254 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:19.234705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:19.235478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:19.235901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:19.249647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] HTTP exception thrown: Instance 80e243da-3288-491a-8046-adf9af156dbe could not be found. May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Request method failure captured: May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe HTTP/1.1 May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOw5yLCVFjsoWpwxaz3qj2k4vebAvxOG7K-UTLcTiKiaB9-nKsRLYQ-UATtFApm3ZP_h1btc47FE_eYTcgoPyL_LSy4qFCc2PRWP_ZEmMU57cKlT9Q5s0abBb-FBqo06lMPErf0ZP6UQfJ1GLW_rYUGP48ha4VeNY90O1sNmeIDp9QU May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 88319789c26e4c7eb549e2e7e70093ee May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesNegativeTest-1385104046 May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:26:19.251300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88319789c26e4c7eb549e2e7e70093ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88319789c26e4c7eb549e2e7e70093ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88319789c26e4c7eb549e2e7e70093ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88319789c26e4c7eb549e2e7e70093ee", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesNegativeTest-1385104046 May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 88319789c26e4c7eb549e2e7e70093ee May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesNegativeTest-1385104046 May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesNegativeTest-1385104046-project May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: cc05a8b1491f4555aa6574cd0904555d May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesNegativeTest-1385104046-project May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 80e243da-3288-491a-8046-adf9af156dbe could not be found. May 09 10:26:19.253370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '80e243da-3288-491a-8046-adf9af156dbe'} May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80e243da-3288-491a-8046-adf9af156dbe could not be found. May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:26:19.254667 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80e243da-3288-491a-8046-adf9af156dbe could not be found. May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80e243da-3288-491a-8046-adf9af156dbe could not be found. May 09 10:26:19.256483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:19.258147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] Returning 404 to user: Instance 80e243da-3288-491a-8046-adf9af156dbe could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:26:19.258147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f28f8230-4b3f-4051-ab7f-406354e60707 tempest-VolumesNegativeTest-1385104046 tempest-VolumesNegativeTest-1385104046-project] 10.222.0.26 "GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe" status: 404 len: 111 microversion: 2.1 time: 0.030694 May 09 10:26:19.258147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1648/3295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:19 2022] GET /compute/v2.1/servers/80e243da-3288-491a-8046-adf9af156dbe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:26:28.633971 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:28.635067 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:28.642198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:28.642857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:28.643848 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:28.644081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:28.685877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9858926-6558-4abd-a243-c573029d2286 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055935 May 09 10:26:28.686469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1648/3296] 10.222.0.26 () {60 vars in 1342 bytes} [Mon May 9 10:26:28 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:26:28.752647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:28.753160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:28.760162 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:28.760337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:28.761152 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:28.761642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:28.791001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:26:28.912331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ccacf76d-d35f-4c1d-8718-881355a05a7e tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 204 len: 0 microversion: 2.20 time: 0.166570 May 09 10:26:28.917366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1649/3297] 10.222.0.26 () {60 vars in 1279 bytes} [Mon May 9 10:26:28 2022] DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 09 10:26:28.921693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:28.922305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:28.944147 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:28.944859 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:28.945814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:28.946394 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:29.111790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:29.120618 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:29.122441 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:29.123863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bbe38497-4685-4790-b0e7-560112be09e3 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.206374 May 09 10:26:29.124684 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1649/3298] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:28 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:26:30.143987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:30.153556 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:30.160326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:30.161296 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:30.162146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:30.162789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:30.432672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:30.444623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:30.446661 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:30.449237 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7258e983-9e55-41cd-89d8-3ca8849f9bfa tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.309023 May 09 10:26:30.450871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1650/3299] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:30 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:26:31.469636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:31.470175 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:31.477314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:31.478317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:31.479191 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:31.479693 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:31.629025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:31.637620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:31.639244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:31.640776 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f1e69011-863c-484f-a353-c3f88a94376c tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1723 microversion: 2.20 time: 0.176438 May 09 10:26:31.641527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1650/3300] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:31 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:26:32.569443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-c0936401-84d8-4fb2-9835-6ecea41bbf0a req-597e30d7-25a2-408c-8df8-ef99d0f3d039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e923da8-ef54-4364-a345-eb053850f0e6", "name": "network-vif-deleted", "tag": "001daf04-3f69-4af0-b1cf-e0ed36819de0"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:32.582037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c0936401-84d8-4fb2-9835-6ecea41bbf0a req-597e30d7-25a2-408c-8df8-ef99d0f3d039 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:32.582819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-c0936401-84d8-4fb2-9835-6ecea41bbf0a req-597e30d7-25a2-408c-8df8-ef99d0f3d039 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:32.598438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-c0936401-84d8-4fb2-9835-6ecea41bbf0a req-597e30d7-25a2-408c-8df8-ef99d0f3d039 service nova] Creating event network-vif-deleted:001daf04-3f69-4af0-b1cf-e0ed36819de0 for instance 0e923da8-ef54-4364-a345-eb053850f0e6 on hv-cinder-84108 May 09 10:26:32.606404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-c0936401-84d8-4fb2-9835-6ecea41bbf0a req-597e30d7-25a2-408c-8df8-ef99d0f3d039 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040273 May 09 10:26:32.607995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1651/3301] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:26:32.659893 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:32.660598 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:32.673079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:32.676515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:32.677486 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:32.678010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:32.725526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:32.726045 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:32.727429 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lazy-loading 'fault' on Instance uuid 0e923da8-ef54-4364-a345-eb053850f0e6 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:26:32.783513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:32.795178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:32.797396 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76dc34045544496ab030864c5a0ffbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c91ae2e41a9487a9ae5fd4bf1b6d4f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:32.798876 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-415be441-b279-48b4-bc35-d6ced2dc85fc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 200 len: 1370 microversion: 2.20 time: 0.143184 May 09 10:26:32.799934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1651/3302] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:32 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 09 10:26:33.818463 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:33.819975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:33.837848 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:33.838940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:33.841039 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:33.842882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:33.902328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] HTTP exception thrown: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Request method failure captured: May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 HTTP/1.1 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMsc-G85dItpEQ6sZve6SjIi-jwVKXSCjOh1vuhpRn6Gy4GbnfqzkH3UQHX-TOg2p6zbTuLckGOQjy8UE2Cmak0c5FGeHrWuCGFr26_BQZE3owStq8wVs3q34q8G_F5fakhv2IKf3mqKLvxPUjd919bauildFFej7hN9a26w8_qy_U May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Openstack-Nova-Api-Version: 2.20 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:26:33.905888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c91ae2e41a9487a9ae5fd4bf1b6d4f8", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 76dc34045544496ab030864c5a0ffbff May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:33.907063 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '0e923da8-ef54-4364-a345-eb053850f0e6'} May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:26:33.907671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:33.908708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:33.913717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Returning 404 to user: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:26:33.915512 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0f595500-820f-486b-b6f0-1960cea11287 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 404 len: 111 microversion: 2.20 time: 0.101371 May 09 10:26:33.916304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1652/3303] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:33 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 10:26:33.930762 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2723f1a4-1a89-40b1-b932-7eaf36ea7757 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '.version_select at 0x7fa45ee29940>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:33.960209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2723f1a4-1a89-40b1-b932-7eaf36ea7757 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-437056667" status: 204 len: 0 microversion: 2.20 time: 0.039115 May 09 10:26:33.961981 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1652/3304] 10.222.0.26 () {60 vars in 1258 bytes} [Mon May 9 10:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-437056667 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 09 10:26:35.827253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4c55cd20-fc6a-4b31-9eee-5c761dac3aae tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Action: 'create', calling method: .version_select at 0x7fa45ef40c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1625543501"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:35.842437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-4c55cd20-fc6a-4b31-9eee-5c761dac3aae tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Getting quotas for project 7b13e936fad64cbcafffb4f896606d4a. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:26:35.846735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-4c55cd20-fc6a-4b31-9eee-5c761dac3aae tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Getting quotas for user ffba3643a2b144739316ea0d5a4c01a9 and project 7b13e936fad64cbcafffb4f896606d4a. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:26:36.061721 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:36.062234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:36.069211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:36.069661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:36.070433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:36.070869 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:36.091323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] HTTP exception thrown: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Request method failure captured: May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 HTTP/1.1 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMsc-G85dItpEQ6sZve6SjIi-jwVKXSCjOh1vuhpRn6Gy4GbnfqzkH3UQHX-TOg2p6zbTuLckGOQjy8UE2Cmak0c5FGeHrWuCGFr26_BQZE3owStq8wVs3q34q8G_F5fakhv2IKf3mqKLvxPUjd919bauildFFej7hN9a26w8_qy_U May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Openstack-Nova-Api-Version: 2.20 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:26:36.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c91ae2e41a9487a9ae5fd4bf1b6d4f8", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 76dc34045544496ab030864c5a0ffbff May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.094341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '0e923da8-ef54-4364-a345-eb053850f0e6'} May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:26:36.095030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.099028 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.100206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Returning 404 to user: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:26:36.100206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7e9e5c18-ca27-4406-b34c-357860b9a981 tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 404 len: 111 microversion: 2.20 time: 0.037231 May 09 10:26:36.100206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1653/3305] 10.222.0.26 () {60 vars in 1279 bytes} [Mon May 9 10:26:36 2022] DELETE /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 10:26:36.102755 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:36.103375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 0e923da8-ef54-4364-a345-eb053850f0e6] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:36.109923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:36.110356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:36.111157 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:36.111608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:36.128654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] HTTP exception thrown: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Request method failure captured: May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 HTTP/1.1 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMsc-G85dItpEQ6sZve6SjIi-jwVKXSCjOh1vuhpRn6Gy4GbnfqzkH3UQHX-TOg2p6zbTuLckGOQjy8UE2Cmak0c5FGeHrWuCGFr26_BQZE3owStq8wVs3q34q8G_F5fakhv2IKf3mqKLvxPUjd919bauildFFej7hN9a26w8_qy_U May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Openstack-Nova-Api-Version: 2.20 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:26:36.130219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c91ae2e41a9487a9ae5fd4bf1b6d4f8", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 76dc34045544496ab030864c5a0ffbff May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.131594 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '0e923da8-ef54-4364-a345-eb053850f0e6'} May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:26:36.132446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. May 09 10:26:36.133727 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:36.134785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Returning 404 to user: Instance 0e923da8-ef54-4364-a345-eb053850f0e6 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:26:36.134785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-824ae4c4-cf45-4fa2-92b6-13eb7293d1ba tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6" status: 404 len: 111 microversion: 2.20 time: 0.032562 May 09 10:26:36.134785 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1654/3306] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:36 2022] GET /compute/v2.1/servers/0e923da8-ef54-4364-a345-eb053850f0e6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 10:26:36.139301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-4c55cd20-fc6a-4b31-9eee-5c761dac3aae tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Getting quotas for project 7b13e936fad64cbcafffb4f896606d4a. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:26:36.143864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-4c55cd20-fc6a-4b31-9eee-5c761dac3aae tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Getting quotas for user ffba3643a2b144739316ea0d5a4c01a9 and project 7b13e936fad64cbcafffb4f896606d4a. Resources: {'key_pairs'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:26:36.158360 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4c55cd20-fc6a-4b31-9eee-5c761dac3aae tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.505637 May 09 10:26:36.158953 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1653/3307] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 10:26:35 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:26:37.293952 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:37.298734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:37.307610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:37.308273 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:37.309538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:37.310173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:37.325233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] HTTP exception thrown: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Request method failure captured: May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 HTTP/1.1 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOMsc-G85dItpEQ6sZve6SjIi-jwVKXSCjOh1vuhpRn6Gy4GbnfqzkH3UQHX-TOg2p6zbTuLckGOQjy8UE2Cmak0c5FGeHrWuCGFr26_BQZE3owStq8wVs3q34q8G_F5fakhv2IKf3mqKLvxPUjd919bauildFFej7hN9a26w8_qy_U May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Openstack-Nova-Api-Version: 2.20 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:26:37.327831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c91ae2e41a9487a9ae5fd4bf1b6d4f8", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 76dc34045544496ab030864c5a0ffbff May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.329078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '2129ee65-9b99-4722-9747-26e9e1419653'} May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:26:37.329760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.331146 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:26:37.332477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Returning 404 to user: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:26:37.332477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8ad4a323-9fc2-478a-b1c8-9a6a0e9740eb tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 404 len: 111 microversion: 2.20 time: 0.044526 May 09 10:26:37.333554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1655/3308] 10.222.0.26 () {60 vars in 1279 bytes} [Mon May 9 10:26:37 2022] DELETE /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 10:26:37.339597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:37.340215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] [instance: 2129ee65-9b99-4722-9747-26e9e1419653] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:37.352168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:37.352617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:37.353429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:37.353864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:37.370775 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] HTTP exception thrown: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Request method failure captured: May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 HTTP/1.1 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMsc-G85dItpEQ6sZve6SjIi-jwVKXSCjOh1vuhpRn6Gy4GbnfqzkH3UQHX-TOg2p6zbTuLckGOQjy8UE2Cmak0c5FGeHrWuCGFr26_BQZE3owStq8wVs3q34q8G_F5fakhv2IKf3mqKLvxPUjd919bauildFFej7hN9a26w8_qy_U May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Openstack-Nova-Api-Version: 2.20 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:26:37.372324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8c91ae2e41a9487a9ae5fd4bf1b6d4f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8c91ae2e41a9487a9ae5fd4bf1b6d4f8", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 8c91ae2e41a9487a9ae5fd4bf1b6d4f8 May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1140333535 May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 76dc34045544496ab030864c5a0ffbff May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1140333535-project May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.373526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '2129ee65-9b99-4722-9747-26e9e1419653'} May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:26:37.374104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. May 09 10:26:37.375163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:26:37.376006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] Returning 404 to user: Instance 2129ee65-9b99-4722-9747-26e9e1419653 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:26:37.376006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b7eeed50-094f-4404-b148-9eab1dce1cfc tempest-AttachVolumeShelveTestJSON-1140333535 tempest-AttachVolumeShelveTestJSON-1140333535-project] 10.222.0.26 "GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653" status: 404 len: 111 microversion: 2.20 time: 0.039003 May 09 10:26:37.376006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1654/3309] 10.222.0.26 () {60 vars in 1276 bytes} [Mon May 9 10:26:37 2022] GET /compute/v2.1/servers/2129ee65-9b99-4722-9747-26e9e1419653 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 09 10:26:58.880861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-388884306", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1625543501", "security_groups": [{"name": "tempest-secgroup-smoke-2017219433"}], "networks": [{"uuid": "c80c8252-a160-4549-bdc5-bc4f66d0c665"}], "block_device_mapping_v2": [{"uuid": "a2bbb4a3-dca3-4280-a621-6ece0826f2ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:26:58.998996 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] validate_networks() for [('c80c8252-a160-4549-bdc5-bc4f66d0c665', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:26:59.656639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:26:59.657089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:26:59.657563 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:26:59.657972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:26:59.658406 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:26:59.667212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:59.667795 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:59.668921 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:26:59.669528 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:26:59.687938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Getting quotas for project 7b13e936fad64cbcafffb4f896606d4a. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:26:59.692061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Getting quotas for user ffba3643a2b144739316ea0d5a4c01a9 and project 7b13e936fad64cbcafffb4f896606d4a. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:26:59.759021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:26:59.761174 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2bbb4a3-dca3-4280-a621-6ece0826f2ee',volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:26:59.886990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a0c95941-597e-454b-961b-87f453009161 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.009938 May 09 10:26:59.887620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1656/3310] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:26:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:26:59.897531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04fd3435-3aaf-4e83-909b-c54c3bb6231c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:26:59.898127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04fd3435-3aaf-4e83-909b-c54c3bb6231c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:26:59.961717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04fd3435-3aaf-4e83-909b-c54c3bb6231c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:26:59.968688 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04fd3435-3aaf-4e83-909b-c54c3bb6231c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1088 microversion: 2.1 time: 0.074994 May 09 10:26:59.969271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1655/3311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:26:59 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:27:00.987352 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:00.988953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:00.996081 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:00.996905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:00.998874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:00.999425 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:01.075451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:01.083990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1d2436f7-b079-4ee8-9d1b-cde1f76d3127 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1204 microversion: 2.1 time: 0.101834 May 09 10:27:01.084531 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1657/3312] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:00 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:27:02.101683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:02.102233 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:02.109833 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:02.110288 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:02.111066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:02.111501 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:02.350575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:02.358751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b042fa75-90db-4165-961c-ebbba349f7ec tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.261038 May 09 10:27:02.359250 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1656/3313] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:02 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:02.732553 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-6c1a67f3-5d30-4ebf-80a8-7d7ba98ae486 req-e4b3d197-beb7-4d4b-8265-f98ae6605cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:02.741283 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-6c1a67f3-5d30-4ebf-80a8-7d7ba98ae486 req-e4b3d197-beb7-4d4b-8265-f98ae6605cd5 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:02.741975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-6c1a67f3-5d30-4ebf-80a8-7d7ba98ae486 req-e4b3d197-beb7-4d4b-8265-f98ae6605cd5 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:02.754033 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-6c1a67f3-5d30-4ebf-80a8-7d7ba98ae486 req-e4b3d197-beb7-4d4b-8265-f98ae6605cd5 service nova] Creating event network-changed:7c0e7067-810f-4deb-ad2e-c6741211f36a for instance dea239ae-edf0-4e2c-882c-eac7762ff254 on hv-cinder-84108 May 09 10:27:02.759374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-6c1a67f3-5d30-4ebf-80a8-7d7ba98ae486 req-e4b3d197-beb7-4d4b-8265-f98ae6605cd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030522 May 09 10:27:02.759961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1658/3314] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:03.375872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:03.376477 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:03.383268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:03.383710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:03.384478 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:03.384957 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:03.525467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:03.533863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00601515-fc5e-464c-83cb-66832fe25f23 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.162022 May 09 10:27:03.534405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1657/3315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:03 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:04.555503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:04.556646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:04.563391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:04.563837 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:04.564645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:04.565167 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:04.699035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:04.707011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6ea62a3d-d0fe-42a7-97fc-5c7c34b0d980 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.156921 May 09 10:27:04.707585 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1659/3316] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:04 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:05.724015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:05.724593 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:05.731967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:05.732489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:05.733717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:05.734271 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:05.889416 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:05.896803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-b9f2f332-4bda-4a83-bcf9-6d72eb09fe16 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.177076 May 09 10:27:05.897366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1658/3317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:05 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:06.914182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:06.914745 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:06.921402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:06.921829 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:06.922589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:06.923014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:07.055691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:07.063190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-eea6d473-4efd-43f6-ae16-e4d1e82387f7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.152985 May 09 10:27:07.063792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1660/3318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:06 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:08.079805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:08.080446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:08.087631 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:08.088073 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:08.088862 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:08.089295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:08.221869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:08.229364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-794a4129-f921-4de4-9c85-15b359d76b1f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.153732 May 09 10:27:08.229947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1659/3319] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:08 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:09.246414 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:09.247030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:09.253788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:09.254301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:09.255397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:09.255850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:09.399711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:09.411074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d7530dc3-028f-406c-bea4-ebc526649526 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.168648 May 09 10:27:09.411662 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1661/3320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:09 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:10.427483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:10.428174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:10.435010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:10.435633 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:10.436430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:10.436895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:10.486214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1824495657", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "networks": [{"uuid": "93e67f55-7ccc-49e4-ad1d-a91d0efef947"}]}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:10.541131 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.network.neutron [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] validate_networks() for [('93e67f55-7ccc-49e4-ad1d-a91d0efef947', None, None, None, None, None)] {{(pid=123637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:27:10.579530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:10.587565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-52249e69-cae8-40c6-b8eb-69af818c19de tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.163965 May 09 10:27:10.588132 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1660/3321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:10 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:10.901024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Flavor limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:27:10.901446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Image limits 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:27:10.901915 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Flavor pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:27:10.902317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Image pref 0:0:0 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:27:10.903058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.virt.hardware [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:27:10.914234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:10.914832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:10.915928 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:10.916527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:10.938825 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Getting quotas for project 438ea2009cc142578a97d17a081e8862. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:27:10.942958 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Getting quotas for user 362a6e9c40944d8e8d818a1300c81983 and project 438ea2009cc142578a97d17a081e8862. Resources: {'cores', 'instances', 'ram'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:27:10.956608 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Going to run 1 instances... {{(pid=123637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:27:10.958935 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:27:11.007933 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fec445b9-1d35-4385-9ddc-479edfae14e9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525691 May 09 10:27:11.013434 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1662/3322] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:27:11.019439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-44e50d03-2dd3-417e-b207-44e10491f42d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:11.020033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-44e50d03-2dd3-417e-b207-44e10491f42d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:11.073800 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-44e50d03-2dd3-417e-b207-44e10491f42d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:11.080513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-44e50d03-2dd3-417e-b207-44e10491f42d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1214 microversion: 2.1 time: 0.065483 May 09 10:27:11.082231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1661/3323] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:11 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:11.605042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:11.605733 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:11.612281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:11.612748 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:11.613810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:11.614243 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:11.752162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:11.760207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fbc9d051-99cc-48c2-992b-f1fdac19c72d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.159544 May 09 10:27:11.761226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1663/3324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:11 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:12.099292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:12.100019 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:12.111470 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:12.111922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:12.112722 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:12.113180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:12.181146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:12.190031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d19fb509-7ed2-4f07-91b6-e35e86f04b60 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1284 microversion: 2.1 time: 0.094449 May 09 10:27:12.190822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1662/3325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:12 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:27:12.782554 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:12.783235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:12.790911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:12.791445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:12.792315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:12.792772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:12.933955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:12.941673 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7a37d419-24b9-4f55-a11e-4249e59d584b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.163010 May 09 10:27:12.942469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1664/3326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:12 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:13.207868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:13.208490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:13.215251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:13.215706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:13.216627 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:13.217145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:13.244919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-5ab0780a-6bb7-4fe9-bed0-b5cfef7b540d req-0b71b335-f600-49e2-8aaf-812af83d6731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "name": "network-vif-plugged", "status": "completed", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:13.255828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5ab0780a-6bb7-4fe9-bed0-b5cfef7b540d req-0b71b335-f600-49e2-8aaf-812af83d6731 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:13.257581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5ab0780a-6bb7-4fe9-bed0-b5cfef7b540d req-0b71b335-f600-49e2-8aaf-812af83d6731 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:13.271214 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-5ab0780a-6bb7-4fe9-bed0-b5cfef7b540d req-0b71b335-f600-49e2-8aaf-812af83d6731 service nova] Creating event network-vif-plugged:7c0e7067-810f-4deb-ad2e-c6741211f36a for instance dea239ae-edf0-4e2c-882c-eac7762ff254 on hv-cinder-84108 May 09 10:27:13.276311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-5ab0780a-6bb7-4fe9-bed0-b5cfef7b540d req-0b71b335-f600-49e2-8aaf-812af83d6731 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 May 09 10:27:13.277027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1665/3327] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:13.418773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:13.427182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-38ee544c-2074-4a8f-9d31-c17756a3d6f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.223465 May 09 10:27:13.427951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1663/3328] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:13 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:13.494680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-59bb969a-2db8-4151-bb98-f3c335b0f23a req-d0c1b14c-df75-4bf0-89c8-8c6d2225ab6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cf90e98-f184-4817-b422-40df5275f096", "tag": "d3446564-a77c-413c-ae50-971e239b8464"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:13.506771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-59bb969a-2db8-4151-bb98-f3c335b0f23a req-d0c1b14c-df75-4bf0-89c8-8c6d2225ab6c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:13.507513 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-59bb969a-2db8-4151-bb98-f3c335b0f23a req-d0c1b14c-df75-4bf0-89c8-8c6d2225ab6c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:13.518898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-59bb969a-2db8-4151-bb98-f3c335b0f23a req-d0c1b14c-df75-4bf0-89c8-8c6d2225ab6c service nova] Creating event network-changed:d3446564-a77c-413c-ae50-971e239b8464 for instance 9cf90e98-f184-4817-b422-40df5275f096 on hv-cinder-84108 May 09 10:27:13.524476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-59bb969a-2db8-4151-bb98-f3c335b0f23a req-d0c1b14c-df75-4bf0-89c8-8c6d2225ab6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 May 09 10:27:13.525516 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1666/3329] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:13.962227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:13.962986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:13.970592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:13.971033 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:13.971795 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:13.972253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:14.111893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:14.123072 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ef0a01a-386d-43fb-af7c-d5c399d2543e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.167295 May 09 10:27:14.123642 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1664/3330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:13 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:14.447481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:14.448199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:14.454992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:14.455444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:14.456523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:14.456993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:14.674751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:14.684568 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8017d2dd-4c37-4e26-a5f7-9db1a4019b0f tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.241652 May 09 10:27:14.685640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1667/3331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:14 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:15.139854 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:15.140414 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:15.147180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:15.147630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:15.148403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:15.148874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:15.291713 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:15.300228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc214abe-89db-4df6-959b-32eeb2ad0384 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.164453 May 09 10:27:15.300952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1665/3332] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:15 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:15.705330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:15.706206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:15.712992 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:15.713439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:15.714199 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:15.714635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:15.849683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:15.858511 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-54a8c9bd-5ae1-41e6-b613-7e07a9b806d5 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.157097 May 09 10:27:15.859088 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1668/3333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:15 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:16.316834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:16.317442 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:16.324219 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:16.324698 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:16.325468 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:16.325902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:16.468935 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:16.477077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce240cfa-a1cb-4a97-bce3-19434b6c4904 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1260 microversion: 2.1 time: 0.164092 May 09 10:27:16.477648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1666/3334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:16 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:16.875967 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:16.876576 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:16.883073 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:16.883538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:16.884297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:16.884753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:17.023851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:17.031978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0ae69d92-8393-4274-aa23-b4369cdba798 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.160262 May 09 10:27:17.032539 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1669/3335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:16 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:17.494782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:17.495329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:17.502423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:17.502875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:17.503646 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:17.504079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:17.647444 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:17.657792 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0eee01e9-3521-4c4d-b90d-540ba7f388af tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1443 microversion: 2.1 time: 0.166793 May 09 10:27:17.658691 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1667/3336] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:17 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1443 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:17.674241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:17.674857 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:17.682002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:17.682555 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:17.683544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:17.684138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:17.893726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:17.902169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2485baf1-f259-4d28-bed7-0e992767334f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1443 microversion: 2.1 time: 0.231634 May 09 10:27:17.902730 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1670/3337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:17 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:18.049340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:18.050301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:18.056614 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:18.057117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:18.057897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:18.058380 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:18.258232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:18.271735 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a9fd4a06-2b93-4dac-b919-44124a92a019 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.226269 May 09 10:27:18.272570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1668/3338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:18 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:19.288943 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:19.289552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:19.297084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:19.297628 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:19.298485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:19.298979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:19.435258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:19.443274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c8581d50-70c0-4079-aa82-fcd39cefa2b0 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.158627 May 09 10:27:19.448909 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1671/3339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:19 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:20.029772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-311d67db-c858-4019-8599-ecb45a61cfc5 req-7d583365-0ad5-4905-9e7b-5e15d424fc40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:20.043805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-311d67db-c858-4019-8599-ecb45a61cfc5 req-7d583365-0ad5-4905-9e7b-5e15d424fc40 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:20.044281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-311d67db-c858-4019-8599-ecb45a61cfc5 req-7d583365-0ad5-4905-9e7b-5e15d424fc40 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:20.056644 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-311d67db-c858-4019-8599-ecb45a61cfc5 req-7d583365-0ad5-4905-9e7b-5e15d424fc40 service nova] Creating event network-changed:7c0e7067-810f-4deb-ad2e-c6741211f36a for instance dea239ae-edf0-4e2c-882c-eac7762ff254 on hv-cinder-84108 May 09 10:27:20.062268 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-311d67db-c858-4019-8599-ecb45a61cfc5 req-7d583365-0ad5-4905-9e7b-5e15d424fc40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037795 May 09 10:27:20.062868 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1669/3340] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:20.461039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:20.461633 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:20.468496 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:20.469210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:20.469990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:20.470424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:20.677597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:20.686030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a1c5ac12-90ef-4e7c-9c33-64de73bbe512 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.228909 May 09 10:27:20.686595 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1672/3341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:20 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:21.307304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-836660a1-cc50-4fa5-976a-00697c2a3b3d req-762da1d9-89b7-4bbf-acab-db7bc4004307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf90e98-f184-4817-b422-40df5275f096", "name": "network-vif-plugged", "status": "completed", "tag": "d3446564-a77c-413c-ae50-971e239b8464"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:21.315856 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-836660a1-cc50-4fa5-976a-00697c2a3b3d req-762da1d9-89b7-4bbf-acab-db7bc4004307 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:21.316429 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-836660a1-cc50-4fa5-976a-00697c2a3b3d req-762da1d9-89b7-4bbf-acab-db7bc4004307 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:21.328851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-836660a1-cc50-4fa5-976a-00697c2a3b3d req-762da1d9-89b7-4bbf-acab-db7bc4004307 service nova] Creating event network-vif-plugged:d3446564-a77c-413c-ae50-971e239b8464 for instance 9cf90e98-f184-4817-b422-40df5275f096 on hv-cinder-84108 May 09 10:27:21.334040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-836660a1-cc50-4fa5-976a-00697c2a3b3d req-762da1d9-89b7-4bbf-acab-db7bc4004307 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031227 May 09 10:27:21.334648 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1670/3342] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:27:21.705077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:21.706324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:21.716523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:21.717032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:21.717803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:21.718239 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:21.870519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:21.881993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e6023dc-67fd-4883-ae86-6820bdd6114a tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.182098 May 09 10:27:21.882764 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1673/3343] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:21 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:22.907299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:22.907956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:22.914887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:22.915333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:22.916247 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:22.916695 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:23.053983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:23.061828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c21013bf-ecbf-4b15-9871-5efda787fe1d tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1314 microversion: 2.1 time: 0.161385 May 09 10:27:23.062397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1671/3344] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:22 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:24.079235 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:24.079823 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:24.086895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:24.087342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:24.088102 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:24.088537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:24.230290 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:24.238337 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44b54137-ad25-4eec-bd72-17535464fa8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1497 microversion: 2.1 time: 0.163328 May 09 10:27:24.238926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1674/3345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:24 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:24.728790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:24.729274 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:24.736127 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:24.736571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:24.737393 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:24.737823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:24.762420 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:27:24.842476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-13c7f280-89c2-4356-863d-c26d2d73bb16 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 204 len: 0 microversion: 2.1 time: 0.117305 May 09 10:27:24.843125 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1672/3346] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:27:24 2022] DELETE /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:27:24.851458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:24.852039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:24.858607 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:24.859055 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:24.859828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:24.860267 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:25.003014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:25.010854 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8e12caeb-d181-4df7-b4ce-2a6a05cf1585 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1503 microversion: 2.1 time: 0.163270 May 09 10:27:25.011422 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1675/3347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:24 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:26.034311 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:26.035060 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:26.042174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:26.042622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:26.043375 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:26.043814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:26.195223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:26.204490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ed523a48-6679-4200-aa74-82f23b755895 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1503 microversion: 2.1 time: 0.174626 May 09 10:27:26.205134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1673/3348] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:26 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:27.006800 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-f5ae9e80-0b2d-4305-a466-fb013096e5d8 req-b0e93788-78b6-45dd-a1c3-173e218e930f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cf90e98-f184-4817-b422-40df5275f096", "name": "network-vif-deleted", "tag": "d3446564-a77c-413c-ae50-971e239b8464"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:27.019716 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f5ae9e80-0b2d-4305-a466-fb013096e5d8 req-b0e93788-78b6-45dd-a1c3-173e218e930f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:27.020211 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-f5ae9e80-0b2d-4305-a466-fb013096e5d8 req-b0e93788-78b6-45dd-a1c3-173e218e930f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:27.035207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-f5ae9e80-0b2d-4305-a466-fb013096e5d8 req-b0e93788-78b6-45dd-a1c3-173e218e930f service nova] Creating event network-vif-deleted:d3446564-a77c-413c-ae50-971e239b8464 for instance 9cf90e98-f184-4817-b422-40df5275f096 on hv-cinder-84108 May 09 10:27:27.041449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-f5ae9e80-0b2d-4305-a466-fb013096e5d8 req-b0e93788-78b6-45dd-a1c3-173e218e930f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038185 May 09 10:27:27.042078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1676/3349] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:27.221902 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:27.222585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:27.229275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:27.229718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:27.230476 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:27.230910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:27.262171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:27.262731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:27.263174 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lazy-loading 'fault' on Instance uuid 9cf90e98-f184-4817-b422-40df5275f096 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:27:27.310048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:27.318035 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-af124801-634f-4014-8417-70f4880eac02 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 200 len: 1304 microversion: 2.1 time: 0.100103 May 09 10:27:27.318607 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1674/3350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:27 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:28.341007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:28.341663 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: 9cf90e98-f184-4817-b422-40df5275f096] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:28.348751 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:28.349197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:28.349969 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:28.350405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:28.363696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] HTTP exception thrown: Instance 9cf90e98-f184-4817-b422-40df5275f096 could not be found. May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Request method failure captured: May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 HTTP/1.1 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOx8-JVVA92Mw9guDC6nbuxUX8XvHvxZm-W8akEoiqUi8j0bFU5_-V_xy8kghSA0THjkn9FD3O_B44cMOpgJmLzrSToor-WQc2a_KnP0NJvX9xBrdC9wYakSuZozmWfaMWwyKpPG2vuVdRzApDPf6n_B8y6E9sq0G5ZY04dW_vSpbG8 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 438ea2009cc142578a97d17a081e8862 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesActionsTest-168959603 May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:27:28.365341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/438ea2009cc142578a97d17a081e8862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/438ea2009cc142578a97d17a081e8862"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/438ea2009cc142578a97d17a081e8862"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_438ea2009cc142578a97d17a081e8862", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesActionsTest-168959603 May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 438ea2009cc142578a97d17a081e8862 May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesActionsTest-168959603 May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesActionsTest-168959603-project May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 362a6e9c40944d8e8d818a1300c81983 May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesActionsTest-168959603-project May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 9cf90e98-f184-4817-b422-40df5275f096 could not be found. May 09 10:27:28.366701 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '9cf90e98-f184-4817-b422-40df5275f096'} May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cf90e98-f184-4817-b422-40df5275f096 could not be found. May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:27:28.367462 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cf90e98-f184-4817-b422-40df5275f096 could not be found. May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cf90e98-f184-4817-b422-40df5275f096 could not be found. May 09 10:27:28.368777 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:28.369818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Returning 404 to user: Instance 9cf90e98-f184-4817-b422-40df5275f096 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:27:28.369818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4a0cf3e7-9534-4fd2-ad81-4592a8fdc704 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096" status: 404 len: 111 microversion: 2.1 time: 0.033478 May 09 10:27:28.369818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1677/3351] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:28 2022] GET /compute/v2.1/servers/9cf90e98-f184-4817-b422-40df5275f096 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:27:28.416206 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-369229593", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "networks": [{"uuid": "93e67f55-7ccc-49e4-ad1d-a91d0efef947"}]}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:28.475736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] validate_networks() for [('93e67f55-7ccc-49e4-ad1d-a91d0efef947', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:27:28.916983 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:27:28.917415 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:27:28.917885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:27:28.918294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:27:28.918700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:27:28.928383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:28.928876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:28.929874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:28.930269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:28.947209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Getting quotas for project 438ea2009cc142578a97d17a081e8862. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:27:28.951326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Getting quotas for user 362a6e9c40944d8e8d818a1300c81983 and project 438ea2009cc142578a97d17a081e8862. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:27:28.962331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:27:28.964702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:27:29.006346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [a47b9c3c-ce8d-4225-9536-678a87a013e6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 09 10:27:30.015890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [a47b9c3c-ce8d-4225-9536-678a87a013e6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52282. May 09 10:27:30.020445 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-a37890d9-a167-44e7-b77f-d0f26d94069e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608110 May 09 10:27:30.021122 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1675/3352] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:27:30.032252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-09502539-39f2-43b0-8a40-98db56db880b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:30.032908 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-09502539-39f2-43b0-8a40-98db56db880b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:30.091397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-09502539-39f2-43b0-8a40-98db56db880b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:30.098210 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-09502539-39f2-43b0-8a40-98db56db880b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1213 microversion: 2.1 time: 0.070614 May 09 10:27:30.098790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1678/3353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:30 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:31.116194 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:31.116849 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:31.124137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:31.124863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:31.125882 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:31.126298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:31.191914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:31.199580 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6dc892f6-59d4-44f4-a2d2-8c1cd12ca78e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1283 microversion: 2.1 time: 0.087991 May 09 10:27:31.200256 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1676/3354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:31 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:32.217655 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:32.218287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:32.225479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:32.225927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:32.226702 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:32.227137 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:32.418363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:32.426342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7bd41db2-0d10-4b52-88a4-37fc521c6130 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.212625 May 09 10:27:32.426975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1679/3355] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:32 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:32.475812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-947ea160-200c-4508-a90d-9c427f6c1fe6 req-835d8f8a-b143-4483-85dc-e634ffd41c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1175a4a-8e7f-4c8d-83aa-93a9fb153688", "tag": "27c7f678-25bb-43c0-b1de-ac2cdb25b00d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:32.485923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-947ea160-200c-4508-a90d-9c427f6c1fe6 req-835d8f8a-b143-4483-85dc-e634ffd41c3e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:32.486498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-947ea160-200c-4508-a90d-9c427f6c1fe6 req-835d8f8a-b143-4483-85dc-e634ffd41c3e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:32.500052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-947ea160-200c-4508-a90d-9c427f6c1fe6 req-835d8f8a-b143-4483-85dc-e634ffd41c3e service nova] Creating event network-changed:27c7f678-25bb-43c0-b1de-ac2cdb25b00d for instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 on hv-cinder-84108 May 09 10:27:32.505324 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-947ea160-200c-4508-a90d-9c427f6c1fe6 req-835d8f8a-b143-4483-85dc-e634ffd41c3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032732 May 09 10:27:32.506180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1677/3356] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:33.445170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:33.445878 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:33.454350 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:33.454926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:33.456118 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:33.456654 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:33.596020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:33.604289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e71240b3-eea3-4598-82b0-e52f423945ee tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.164129 May 09 10:27:33.604947 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1680/3357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:33 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:34.624736 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:34.625518 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:34.635394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:34.635834 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:34.636962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:34.637524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:34.782457 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:34.790486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4ae11f2e-610a-4465-a4e6-d1c3fd689d8c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.172094 May 09 10:27:34.791037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1678/3358] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:34 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:35.807524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:35.808139 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:35.815160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:35.815542 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:35.816314 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:35.816750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:35.982834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:35.990264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-520b58cf-8ef6-400b-b57b-b838b6227ac1 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.186729 May 09 10:27:35.990841 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1681/3359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:35 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:37.007677 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:37.008251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:37.014936 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:37.015379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:37.016143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:37.016570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:37.164540 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:37.176018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d9e3c05e-82d0-4a68-a686-6f184d4ed676 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.171996 May 09 10:27:37.176807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1679/3360] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:37 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:38.197672 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:38.198212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:38.207656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:38.208289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:38.209356 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:38.209988 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:38.362253 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:38.373741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adc9a9be-2d2e-438e-8a2a-5053f710aa3c tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.181493 May 09 10:27:38.374803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1682/3361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:38 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:39.372435 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-cfc5b341-949d-46f8-b91a-aa6df346cbca req-f50a86b3-5245-4629-bed5-7bbff57271a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1175a4a-8e7f-4c8d-83aa-93a9fb153688", "name": "network-vif-plugged", "status": "completed", "tag": "27c7f678-25bb-43c0-b1de-ac2cdb25b00d"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:39.382031 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cfc5b341-949d-46f8-b91a-aa6df346cbca req-f50a86b3-5245-4629-bed5-7bbff57271a4 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:39.382485 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cfc5b341-949d-46f8-b91a-aa6df346cbca req-f50a86b3-5245-4629-bed5-7bbff57271a4 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:39.392252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:39.393050 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:39.395218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-cfc5b341-949d-46f8-b91a-aa6df346cbca req-f50a86b3-5245-4629-bed5-7bbff57271a4 service nova] Creating event network-vif-plugged:27c7f678-25bb-43c0-b1de-ac2cdb25b00d for instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 on hv-cinder-84108 May 09 10:27:39.400331 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-cfc5b341-949d-46f8-b91a-aa6df346cbca req-f50a86b3-5245-4629-bed5-7bbff57271a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 May 09 10:27:39.400931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:39.401141 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1680/3362] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:39.401731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:39.402526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:39.403082 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:39.543035 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:39.552229 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ba94d727-26bb-4ded-b156-197ae581184b tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.163591 May 09 10:27:39.553372 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1683/3363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:39 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:40.572690 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:40.573397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:40.580407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:40.580893 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:40.581656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:40.582084 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:40.717536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:40.727888 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c9a2806a-11ad-43a2-b775-a32312d716f9 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1313 microversion: 2.1 time: 0.159638 May 09 10:27:40.728649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1681/3364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:40 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:41.747120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:41.747731 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:41.754652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:41.755099 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:41.755872 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:41.756303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:41.913897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:41.925712 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a9c5f745-6c44-4750-a617-0e63d53edeff tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1497 microversion: 2.1 time: 0.182648 May 09 10:27:41.926450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1684/3365] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:41 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:42.468269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:42.468815 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:42.475350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:42.475803 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:42.476567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:42.477028 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:42.501801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:27:42.582136 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-88dd1fb6-5e8f-40b3-a2b0-fe72e14aef0e tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 204 len: 0 microversion: 2.1 time: 0.117566 May 09 10:27:42.582399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1682/3366] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:27:42 2022] DELETE /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:27:42.591344 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:42.591980 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:42.598251 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:42.598698 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:42.599458 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:42.599886 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:42.740183 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:42.751650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9f9f48f6-8844-4fb5-b437-e660ca9c5c57 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1503 microversion: 2.1 time: 0.164037 May 09 10:27:42.752250 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1685/3367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:42 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:43.769613 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:43.770290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:43.777464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:43.777969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:43.778805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:43.779282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:43.921718 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:43.930784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2b5dd019-71b0-4229-8c71-5b39af1a70f3 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1503 microversion: 2.1 time: 0.165391 May 09 10:27:43.931337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1683/3368] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:43 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:44.770761 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-0a0496d2-dccb-4403-a433-8427fb7a4f66 req-8d0d6b8f-965a-408c-9ca0-2f7793ff4180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1175a4a-8e7f-4c8d-83aa-93a9fb153688", "name": "network-vif-deleted", "tag": "27c7f678-25bb-43c0-b1de-ac2cdb25b00d"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:27:44.780315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-0a0496d2-dccb-4403-a433-8427fb7a4f66 req-8d0d6b8f-965a-408c-9ca0-2f7793ff4180 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:44.780781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-0a0496d2-dccb-4403-a433-8427fb7a4f66 req-8d0d6b8f-965a-408c-9ca0-2f7793ff4180 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:44.792750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-0a0496d2-dccb-4403-a433-8427fb7a4f66 req-8d0d6b8f-965a-408c-9ca0-2f7793ff4180 service nova] Creating event network-vif-deleted:27c7f678-25bb-43c0-b1de-ac2cdb25b00d for instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 on hv-cinder-84108 May 09 10:27:44.798368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-0a0496d2-dccb-4403-a433-8427fb7a4f66 req-8d0d6b8f-965a-408c-9ca0-2f7793ff4180 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 May 09 10:27:44.799041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1686/3369] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:27:44.953625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:44.954227 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:44.961104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:44.961520 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:44.962277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:44.962730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:44.996079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:44.996827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:44.997448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lazy-loading 'fault' on Instance uuid b1175a4a-8e7f-4c8d-83aa-93a9fb153688 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:27:45.042618 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '362a6e9c40944d8e8d818a1300c81983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '438ea2009cc142578a97d17a081e8862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:27:45.050308 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ee37536f-3f26-47cc-bd92-6c05581fd107 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 200 len: 1303 microversion: 2.1 time: 0.100513 May 09 10:27:45.050863 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1684/3370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:44 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:27:46.075560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:27:46.076258 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] [instance: b1175a4a-8e7f-4c8d-83aa-93a9fb153688] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:27:46.083333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:46.083788 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:46.084566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:27:46.085034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:27:46.098683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] HTTP exception thrown: Instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 could not be found. May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Request method failure captured: May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 HTTP/1.1 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieOx8-JVVA92Mw9guDC6nbuxUX8XvHvxZm-W8akEoiqUi8j0bFU5_-V_xy8kghSA0THjkn9FD3O_B44cMOpgJmLzrSToor-WQc2a_KnP0NJvX9xBrdC9wYakSuZozmWfaMWwyKpPG2vuVdRzApDPf6n_B8y6E9sq0G5ZY04dW_vSpbG8 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 438ea2009cc142578a97d17a081e8862 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-VolumesActionsTest-168959603 May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:27:46.100307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/438ea2009cc142578a97d17a081e8862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/438ea2009cc142578a97d17a081e8862"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/438ea2009cc142578a97d17a081e8862"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_438ea2009cc142578a97d17a081e8862", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-VolumesActionsTest-168959603 May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 438ea2009cc142578a97d17a081e8862 May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-VolumesActionsTest-168959603 May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-VolumesActionsTest-168959603-project May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: 362a6e9c40944d8e8d818a1300c81983 May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-VolumesActionsTest-168959603-project May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 could not be found. May 09 10:27:46.101638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'b1175a4a-8e7f-4c8d-83aa-93a9fb153688'} May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 could not be found. May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:27:46.102272 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 could not be found. May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 could not be found. May 09 10:27:46.103870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:27:46.105254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] Returning 404 to user: Instance b1175a4a-8e7f-4c8d-83aa-93a9fb153688 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:27:46.105254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6a285630-169c-4728-a2a9-092ad006f379 tempest-VolumesActionsTest-168959603 tempest-VolumesActionsTest-168959603-project] 10.222.0.26 "GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688" status: 404 len: 111 microversion: 2.1 time: 0.032826 May 09 10:27:46.105254 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1687/3371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:27:46 2022] GET /compute/v2.1/servers/b1175a4a-8e7f-4c8d-83aa-93a9fb153688 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:29:46.670093 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:29:46.670717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:46.677231 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:46.677675 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:46.678448 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:46.678879 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:46.704489 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lazy-loading 'flavor' on Instance uuid dea239ae-edf0-4e2c-882c-eac7762ff254 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:29:46.813488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1b6fb7be-e531-42fc-81ef-76b90904a00d tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "POST /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254/action" status: 202 len: 0 microversion: 2.1 time: 0.149470 May 09 10:29:46.813980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1685/3372] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 10:29:46 2022] POST /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:29:46.820635 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ce6fa76-c806-4301-8d14-da40d6f02e53] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 09 10:29:46.824623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:46.825347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:46.832338 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:46.832834 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:46.833697 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:46.834122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:46.972428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:46.980224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2692675f-15e0-4d93-a160-e106363c24b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.161933 May 09 10:29:46.980814 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1688/3373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:46 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:47.998923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:47.999615 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:48.006105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:48.006528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:48.007328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:48.007761 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:48.145037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:48.153739 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-fc055f25-b94f-4adc-8ffc-a7777d4468e1 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.159698 May 09 10:29:48.154287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1686/3374] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:47 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:49.171455 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:49.172049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:49.180525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:49.181000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:49.181771 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:49.182201 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:49.187747 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ce6fa76-c806-4301-8d14-da40d6f02e53] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53282. May 09 10:29:49.326103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:49.335385 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b805b7f5-c3e5-4d7f-9db3-bfbbe81f6e6b tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.167614 May 09 10:29:49.336281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1689/3375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:49 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:50.356575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:50.357335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:50.364080 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:50.364500 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:50.365327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:50.365767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:50.497743 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:50.505725 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7cbb43c3-4cb2-4b05-9e9e-ed266ae2a540 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.153111 May 09 10:29:50.506310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1687/3376] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:50 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:51.523018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:51.523732 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:51.530316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:51.530769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:51.531759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:51.532192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:51.665169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:51.673363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-293ffe42-688d-49a9-8132-6f5de601d6d7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.154262 May 09 10:29:51.673941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1690/3377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:51 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:52.690180 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:52.690791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:52.697562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:52.698010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:52.698788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:52.699225 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:52.836812 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:52.844719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f80cb0a-1e3f-4eb6-962b-ca7f8aefffe9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.158483 May 09 10:29:52.845351 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1688/3378] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:52 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:53.862368 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:53.862934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:53.871021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:53.872978 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:53.873858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:53.875448 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:54.015998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:54.023850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47c216fb-24d3-42ec-9b5d-f609c3bf095f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.165395 May 09 10:29:54.024453 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1691/3379] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:53 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:55.042099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:55.042670 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:55.049897 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:55.050340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:55.051114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:55.051547 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:55.183253 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:55.191135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-136ad400-d9e7-4ba1-be34-188c79537451 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.153506 May 09 10:29:55.191727 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1689/3380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:55 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:56.208460 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:56.211281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:56.216264 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:56.216703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:56.217503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:56.217936 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:56.353606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:56.362132 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a000d99-85c1-4dd6-aada-47a581ea3a62 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.157557 May 09 10:29:56.362809 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1692/3381] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:56 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:57.380086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:57.380708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:57.388781 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:57.389116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:57.390100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:57.390533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:57.531884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:57.546441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6e5f7d1e-d3d9-4fd7-a129-95b6147fd556 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.170817 May 09 10:29:57.547062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1690/3382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:57 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:58.563614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:58.564232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:58.571049 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:58.571502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:58.572289 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:58.572760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:58.708924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:58.718877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a991e93a-83b1-4eeb-8f41-217d809461a9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.159111 May 09 10:29:58.719433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1693/3383] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:58 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:29:59.736359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:29:59.736952 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:59.743908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:59.744359 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:59.745175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:59.745609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:59.881676 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:29:59.890336 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5c88f60-78e9-456e-a2bc-808fa2213bc5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1569 microversion: 2.1 time: 0.157916 May 09 10:29:59.891085 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1691/3384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:29:59 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:29:59.907849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:29:59.908634 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:29:59.915887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:59.916418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:29:59.918002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:29:59.918953 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:00.050964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5c8ad321-53d9-4cf5-9c24-0b8dadac6d5e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "POST /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254/action" status: 202 len: 0 microversion: 2.1 time: 0.147157 May 09 10:30:00.052040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1694/3385] 10.222.0.26 () {60 vars in 1277 bytes} [Mon May 9 10:29:59 2022] POST /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 10:30:00.066024 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:00.067730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:00.080229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:00.081117 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:00.082805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:00.083563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:00.293224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:00.311183 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7297b912-f2bf-4ace-b327-f1997c2626d4 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1517 microversion: 2.1 time: 0.252591 May 09 10:30:00.311843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1692/3386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:00 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1517 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:01.334763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:01.335380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:01.342244 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:01.342704 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:01.343487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:01.343923 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:01.524122 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:01.533182 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e67c0fa9-b7b2-4615-9c4f-0bbb7e91b858 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1519 microversion: 2.1 time: 0.202820 May 09 10:30:01.533998 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1695/3387] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:01 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:02.154617 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-5f4f067d-5cfe-419b-a060-8ad03e63841f req-683c1a22-7ef5-4f5b-bae1-7c0d45e95057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "name": "network-vif-unplugged", "status": "completed", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:02.167203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-5f4f067d-5cfe-419b-a060-8ad03e63841f req-683c1a22-7ef5-4f5b-bae1-7c0d45e95057 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:02.167423 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-5f4f067d-5cfe-419b-a060-8ad03e63841f req-683c1a22-7ef5-4f5b-bae1-7c0d45e95057 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:02.188923 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.compute.server_external_events [req-5f4f067d-5cfe-419b-a060-8ad03e63841f req-683c1a22-7ef5-4f5b-bae1-7c0d45e95057 service nova] Unable to find a host for instance dea239ae-edf0-4e2c-882c-eac7762ff254. Dropping event network-vif-unplugged {{(pid=123638) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 09 10:30:02.189839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-5f4f067d-5cfe-419b-a060-8ad03e63841f req-683c1a22-7ef5-4f5b-bae1-7c0d45e95057 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.139644 May 09 10:30:02.190450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1693/3388] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 141 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 09 10:30:02.562014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:02.563013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:02.571647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:02.572091 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:02.572946 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:02.573359 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:02.772315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:02.785926 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e849aa0c-58a4-468c-a04a-8b15546bf8b9 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.231934 May 09 10:30:02.786956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1696/3389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:02 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:03.811963 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:03.812813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:03.820751 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:03.821203 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:03.821987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:03.822418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:03.996327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:04.008624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1535fa70-fa21-4dc2-ba0d-0d87e0a54e08 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.201349 May 09 10:30:04.009687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1694/3390] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:03 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:05.029263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:05.030110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:05.039900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:05.040428 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:05.041524 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:05.042069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:05.220959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:05.229230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0f6416a0-998f-4f0e-beaa-0a45fc988a04 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.205843 May 09 10:30:05.230018 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1697/3391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:05 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:05.980046 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:05.980700 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:05.987089 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:05.987527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:05.988297 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:05.988754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:06.015694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:30:06.103571 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-231cd94e-05ed-4352-99c2-299b8e5bc1b7 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 204 len: 0 microversion: 2.1 time: 0.126919 May 09 10:30:06.104566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1695/3392] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:30:05 2022] DELETE /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:30:06.114044 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:06.114700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:06.121620 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:06.122077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:06.122874 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:06.123312 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:06.246981 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:06.247776 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:06.254441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:06.254992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:06.255851 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:06.256354 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:06.288798 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:06.296769 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-adf35d56-28a0-4aca-86c0-002e58553779 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1508 microversion: 2.1 time: 0.186661 May 09 10:30:06.297397 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1698/3393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:06 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:06.422920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:06.431790 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d86955ce-c5b1-40cb-bc17-2955d2a8f1da tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.188995 May 09 10:30:06.432382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1696/3394] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:06 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:07.313426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:07.314169 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:07.321317 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:07.321767 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:07.322600 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:07.323036 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:07.449920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:07.450787 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:07.461032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:07.461949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:07.463507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:07.464294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:07.643824 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:07.658307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-550811f1-5ba9-4c2e-a1b8-275f66abd1fc tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.212179 May 09 10:30:07.659368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1697/3395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:07 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:30:07.850136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:07.863418 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-99d0c4c8-5ba5-47fe-9f43-2ead43b9b8f0 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 200 len: 1508 microversion: 2.1 time: 0.553637 May 09 10:30:07.864656 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1699/3396] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:07 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 1508 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:07.939968 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-cfbb2a1c-b166-4c32-b00a-e2e3f6214c3f req-e6e730ec-cdba-43c4-b3e9-eb182284aa3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fba23c7-5891-4c59-b6bb-fdf8705aedfc", "name": "network-vif-deleted", "tag": "23ef4361-2d67-4758-8fee-e25f0fd77c09"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:07.957659 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cfbb2a1c-b166-4c32-b00a-e2e3f6214c3f req-e6e730ec-cdba-43c4-b3e9-eb182284aa3d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:07.958451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-cfbb2a1c-b166-4c32-b00a-e2e3f6214c3f req-e6e730ec-cdba-43c4-b3e9-eb182284aa3d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:07.982697 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-cfbb2a1c-b166-4c32-b00a-e2e3f6214c3f req-e6e730ec-cdba-43c4-b3e9-eb182284aa3d service nova] Creating event network-vif-deleted:23ef4361-2d67-4758-8fee-e25f0fd77c09 for instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc on hv-cinder-84108 May 09 10:30:07.992010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-cfbb2a1c-b166-4c32-b00a-e2e3f6214c3f req-e6e730ec-cdba-43c4-b3e9-eb182284aa3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158956 May 09 10:30:07.993198 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1698/3397] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:30:08.684692 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:08.685423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:08.692819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:08.693274 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:08.694084 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:08.694523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:08.882798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:08.883924 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 0fba23c7-5891-4c59-b6bb-fdf8705aedfc] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:08.891943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:08.892399 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:08.893270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:08.893672 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:08.909171 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc could not be found. May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc HTTP/1.1 May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:30:08.911043 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc could not be found. May 09 10:30:08.917405 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '0fba23c7-5891-4c59-b6bb-fdf8705aedfc'} May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc could not be found. May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:30:08.918839 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc could not be found. May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc could not be found. May 09 10:30:08.921018 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:08.922920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 404 to user: Instance 0fba23c7-5891-4c59-b6bb-fdf8705aedfc could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:30:08.922920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f563521f-a69f-46c5-b101-ba04bad08dfd tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc" status: 404 len: 111 microversion: 2.1 time: 0.034620 May 09 10:30:08.922920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1699/3398] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:08 2022] GET /compute/v2.1/servers/0fba23c7-5891-4c59-b6bb-fdf8705aedfc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:30:08.922920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:08.922920 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:08.929038 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:08.929514 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:08.930277 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:08.930711 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:08.959321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:30:09.000680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:09.008839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d9539329-c1c3-401e-aa5d-4d1b8561bb80 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.328424 May 09 10:30:09.009457 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1700/3399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:08 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:09.055175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95477a44-b6b6-4226-96c2-15053e150f04 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "DELETE /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 204 len: 0 microversion: 2.1 time: 0.136688 May 09 10:30:09.056178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1700/3400] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:30:08 2022] DELETE /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 10:30:09.065123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:09.065782 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:09.072308 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:09.072780 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:09.073562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:09.073993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:09.221972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:09.230627 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-823e9092-7f36-4fce-b550-2ad44fea562c tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.169994 May 09 10:30:09.231228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1701/3401] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:09 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:10.031840 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:10.032532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:10.040131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:10.040683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:10.041658 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:10.042527 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:10.195582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:10.204679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5ae77a2c-8c61-47bc-b367-752c9aff847f tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.177399 May 09 10:30:10.205481 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1701/3402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:10 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:10.248320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:10.249032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:10.256034 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:10.256490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:10.257383 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:10.257817 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:10.411500 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:10.424180 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-0a7c621d-7d32-4b98-b227-3d01b0da724d tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1522 microversion: 2.1 time: 0.179427 May 09 10:30:10.425176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1702/3403] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:10 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:11.196853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-338a801b-740e-4a3d-98d9-4ca25231690b req-c7833721-286a-4a52-9a48-2ca35de73d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1", "name": "network-vif-deleted", "tag": "6aeb5a3e-699b-40df-b1af-50d7e539a438"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:11.214767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-338a801b-740e-4a3d-98d9-4ca25231690b req-c7833721-286a-4a52-9a48-2ca35de73d3b service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:11.215486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-338a801b-740e-4a3d-98d9-4ca25231690b req-c7833721-286a-4a52-9a48-2ca35de73d3b service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:11.227532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:11.228696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:11.235592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-338a801b-740e-4a3d-98d9-4ca25231690b req-c7833721-286a-4a52-9a48-2ca35de73d3b service nova] Creating event network-vif-deleted:6aeb5a3e-699b-40df-b1af-50d7e539a438 for instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 on hv-cinder-84108 May 09 10:30:11.240508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:11.242057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:11.244341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:11.245473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:11.247026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-338a801b-740e-4a3d-98d9-4ca25231690b req-c7833721-286a-4a52-9a48-2ca35de73d3b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054171 May 09 10:30:11.249147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1702/3404] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:30:11.450235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:11.450846 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:11.458027 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:11.458503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:11.459314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:11.459724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:11.478493 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:11.492650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-79f695d5-f5b3-46eb-a981-9e6abd47e114 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.273020 May 09 10:30:11.493818 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1703/3405] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:11 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:30:11.498876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:11.499329 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:11.499794 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lazy-loading 'fault' on Instance uuid 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:30:11.651531 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e58c14dca7da4e6495f7e08f2bb127e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0511fef4fd9f4bd09a3b1867e8556a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:11.660011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-c5934d1a-e618-4f24-bad0-d36e9124e325 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 200 len: 1312 microversion: 2.1 time: 0.214911 May 09 10:30:11.660595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1703/3406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:11 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:30:12.512525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:12.513335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:12.520207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:12.520636 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:12.521562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:12.521997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:12.683568 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:12.684907 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] [instance: 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:12.692402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:12.694131 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:12.694843 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:12.696114 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:12.696754 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:12.704602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ac79d45b-5c93-4b38-a149-01395c20ec99 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.196045 May 09 10:30:12.705226 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1704/3407] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:12 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:12.722671 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] HTTP exception thrown: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 could not be found. May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Request method failure captured: May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 HTTP/1.1 May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOMwtcPElhn7DvRkz9wmkVcSyBZhnWLZKpPW-i70j5V0NnB93wsNzm6OMkthlWoVLz9LRC5he9vo5jir8MlsXss0xMZqE6aUN5eRQq2SRKDnESeR3CbmcYrHVK6URnTvo1IeVw9w1rgAr5yHkuDGWlSUS9OAtIs_-n53bdoU0c9d_ZY May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:30:12.724558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0511fef4fd9f4bd09a3b1867e8556a06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0511fef4fd9f4bd09a3b1867e8556a06", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 0511fef4fd9f4bd09a3b1867e8556a06 May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2043220891 May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: e58c14dca7da4e6495f7e08f2bb127e2 May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2043220891-project May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 could not be found. May 09 10:30:12.726801 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1'} May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 could not be found. May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:30:12.728373 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 could not be found. May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 could not be found. May 09 10:30:12.730719 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:30:12.732956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] Returning 404 to user: Instance 584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:30:12.732956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6237c928-af5e-46f9-96a0-046f90b5cca8 tempest-ServerRescueNegativeTestJSON-2043220891 tempest-ServerRescueNegativeTestJSON-2043220891-project] 10.222.0.26 "GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1" status: 404 len: 111 microversion: 2.1 time: 0.050519 May 09 10:30:12.732956 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1704/3408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:12 2022] GET /compute/v2.1/servers/584ad9b7-d9b6-46a9-a6f5-52f4f7ce63b1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:30:13.737864 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:13.739037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:13.751100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:13.751877 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:13.753213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:13.753965 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:14.011847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:14.028301 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-47041256-4327-4c02-882c-f2d98b71e377 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.297493 May 09 10:30:14.032285 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1705/3409] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:13 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:14.228283 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-47495ed4-8bc0-4bd4-9c48-b45fff3334b2 req-af049239-848b-4f1d-9682-64382d316e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "name": "network-vif-plugged", "status": "completed", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:14.241752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-47495ed4-8bc0-4bd4-9c48-b45fff3334b2 req-af049239-848b-4f1d-9682-64382d316e14 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:14.242779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-47495ed4-8bc0-4bd4-9c48-b45fff3334b2 req-af049239-848b-4f1d-9682-64382d316e14 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:14.264773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-47495ed4-8bc0-4bd4-9c48-b45fff3334b2 req-af049239-848b-4f1d-9682-64382d316e14 service nova] Creating event network-vif-plugged:7c0e7067-810f-4deb-ad2e-c6741211f36a for instance dea239ae-edf0-4e2c-882c-eac7762ff254 on hv-cinder-84108 May 09 10:30:14.272558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-47495ed4-8bc0-4bd4-9c48-b45fff3334b2 req-af049239-848b-4f1d-9682-64382d316e14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049623 May 09 10:30:14.273783 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1705/3410] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:30:15.061711 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:15.063791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:15.076646 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:15.077481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:15.078961 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:15.079723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:15.366016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:15.386629 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e1f9ebc3-6401-4a4b-aaf6-403650450345 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1575 microversion: 2.1 time: 0.331830 May 09 10:30:15.387937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1706/3411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:15 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1575 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:16.413406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:16.414111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:16.421837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:16.422279 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:16.423062 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:16.423492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:16.704464 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:16.712992 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e659881f-c142-45a9-849a-cf02cb3fc51a tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1562 microversion: 2.1 time: 0.303931 May 09 10:30:16.714467 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1706/3412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:16 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1562 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:24.110593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e6365c91-ac64-4387-baf8-1b2b17c40a72 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: .version_select at 0x7fa467f90e50>, body: {"keypair": {"name": "tempest-keypair-2095746231"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:24.132492 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-e6365c91-ac64-4387-baf8-1b2b17c40a72 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:30:24.138838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-e6365c91-ac64-4387-baf8-1b2b17c40a72 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:30:24.792822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-e6365c91-ac64-4387-baf8-1b2b17c40a72 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:30:24.799695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-e6365c91-ac64-4387-baf8-1b2b17c40a72 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:30:24.820801 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e6365c91-ac64-4387-baf8-1b2b17c40a72 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.904495 May 09 10:30:24.821699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1707/3413] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 10:30:23 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:26.639450 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1652388628", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bd2fd6b-89d5-4ef4-83f7-9561f023906c"}], "security_groups": [{"name": "tempest-securitygroup--1763647718"}], "key_name": "tempest-keypair-2095746231", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:26.768842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] validate_networks() for [('8bd2fd6b-89d5-4ef4-83f7-9561f023906c', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:30:27.334298 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:30:27.335087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:30:27.336045 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:30:27.337335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:30:27.338622 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:30:27.355322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:27.356548 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:27.358454 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:27.359248 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:27.393430 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:30:27.401941 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:30:27.421188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:30:27.423880 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:30:27.494251 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-31a8a307-5e06-4968-958d-d6ff37bbc37f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858850 May 09 10:30:27.495566 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1707/3414] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:30:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:30:27.506260 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7024444-b265-4fec-ac06-aeacd01c45a6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:27.507161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7024444-b265-4fec-ac06-aeacd01c45a6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:27.583219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7024444-b265-4fec-ac06-aeacd01c45a6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:27.592213 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7024444-b265-4fec-ac06-aeacd01c45a6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1242 microversion: 2.1 time: 0.090208 May 09 10:30:27.593092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1708/3415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:27 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:28.616449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:28.617486 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:28.627441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:28.628384 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:28.629637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:28.630287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:28.739124 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:28.752980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7a066e1c-f014-4762-987b-94b3c90ef2ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1294 microversion: 2.1 time: 0.145289 May 09 10:30:28.753872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1708/3416] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:28 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1294 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:29.774138 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:29.774966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:29.782617 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:29.783065 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:29.784233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:29.784740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:29.891173 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:29.902479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-66df3237-d1fa-49bc-b24a-d96508944e01 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1300 microversion: 2.1 time: 0.132310 May 09 10:30:29.903224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1709/3417] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:29 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:30.926712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:30.927774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:30.940422 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:30.941139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:30.942585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:30.943335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:30.967739 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-437002d2-a1de-42ef-9cad-44fd9c0aebca req-36b54c7a-b6a9-44af-9419-088cff06a2af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541672f9-79e5-466b-a3ac-ca41ebba8a0f", "tag": "2b9f99a2-35bd-4567-8813-b8ea65fca80b"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:30.996364 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-437002d2-a1de-42ef-9cad-44fd9c0aebca req-36b54c7a-b6a9-44af-9419-088cff06a2af service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:31.000341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-437002d2-a1de-42ef-9cad-44fd9c0aebca req-36b54c7a-b6a9-44af-9419-088cff06a2af service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:31.047867 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-437002d2-a1de-42ef-9cad-44fd9c0aebca req-36b54c7a-b6a9-44af-9419-088cff06a2af service nova] Creating event network-changed:2b9f99a2-35bd-4567-8813-b8ea65fca80b for instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f on hv-cinder-84108 May 09 10:30:31.059842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-437002d2-a1de-42ef-9cad-44fd9c0aebca req-36b54c7a-b6a9-44af-9419-088cff06a2af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100693 May 09 10:30:31.061851 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1710/3418] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:30:31.187694 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:31.202903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-de559312-ba6f-4173-935a-4a02d91b5e50 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.282907 May 09 10:30:31.204056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1709/3419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:30 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:32.226850 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:32.227725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:32.235053 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:32.235660 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:32.236527 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:32.237058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:32.391110 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:32.399831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a7277af5-995b-4f42-bd1a-4cb585594fa4 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.177681 May 09 10:30:32.400380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1711/3420] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:32 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:33.417976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:33.418889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:33.427168 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:33.427710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:33.428820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:33.429395 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:33.637170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:33.647003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-05008cfa-df5b-4554-9706-17979853a9ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.233308 May 09 10:30:33.647732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1710/3421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:33 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:34.665078 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:34.665694 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:34.673016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:34.673474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:34.674293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:34.674757 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:34.833955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:34.847499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-cc898c1d-2a13-4f13-810c-13df0215cfea tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.186300 May 09 10:30:34.848494 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1712/3422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:34 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:35.872788 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:35.873516 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:35.881057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:35.881585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:35.882526 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:35.883015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:36.040052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:36.048947 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-26802360-428d-4204-bd0f-c1f1db38f5c2 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.180205 May 09 10:30:36.049539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1711/3423] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:35 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:36.320207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-b733bfed-37fb-49d8-9082-90013592d72e req-7f93cf45-08e9-48b8-93d7-766882cf45d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541672f9-79e5-466b-a3ac-ca41ebba8a0f", "name": "network-vif-plugged", "status": "completed", "tag": "2b9f99a2-35bd-4567-8813-b8ea65fca80b"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:36.338683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b733bfed-37fb-49d8-9082-90013592d72e req-7f93cf45-08e9-48b8-93d7-766882cf45d1 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:36.339379 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-b733bfed-37fb-49d8-9082-90013592d72e req-7f93cf45-08e9-48b8-93d7-766882cf45d1 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:36.355443 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-b733bfed-37fb-49d8-9082-90013592d72e req-7f93cf45-08e9-48b8-93d7-766882cf45d1 service nova] Creating event network-vif-plugged:2b9f99a2-35bd-4567-8813-b8ea65fca80b for instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f on hv-cinder-84108 May 09 10:30:36.362016 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-b733bfed-37fb-49d8-9082-90013592d72e req-7f93cf45-08e9-48b8-93d7-766882cf45d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046804 May 09 10:30:36.362925 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1713/3424] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:30:37.067585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:37.068624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:37.077121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:37.077716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:37.078701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:37.079193 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:37.255102 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:37.264984 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1f330088-1f2c-47a8-88aa-bc54c2405d8c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.201955 May 09 10:30:37.265724 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1712/3425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:37 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:38.284198 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:38.284938 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:38.292347 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:38.292853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:38.293653 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:38.294093 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:38.466606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:38.474792 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bd8d2de1-7a29-4d89-aa78-76722a4affcf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1368 microversion: 2.1 time: 0.195333 May 09 10:30:38.475405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1714/3426] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:38 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:39.493870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:39.494578 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:39.501120 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:39.501563 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:39.502369 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:39.502810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:39.646768 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:30:39.654930 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-45645383-7310-46da-8990-3f3f9d181e38 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1558 microversion: 2.1 time: 0.165062 May 09 10:30:39.655524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1713/3427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:30:39 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:30:39.673197 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:30:39.674141 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:30:39.681423 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:39.682077 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:39.683027 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:39.683578 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:39.775880 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-38576b51-2db8-410c-8ee7-52943b8670b1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106814 May 09 10:30:39.776609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1715/3428] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 10:30:39 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:30:40.980716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-295b7c8d-fb20-4f5d-88c1-8ec4c68b63a7 req-62112970-8a4d-496e-994c-4a643c09f51c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541672f9-79e5-466b-a3ac-ca41ebba8a0f", "tag": "2b9f99a2-35bd-4567-8813-b8ea65fca80b"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:30:40.992777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-295b7c8d-fb20-4f5d-88c1-8ec4c68b63a7 req-62112970-8a4d-496e-994c-4a643c09f51c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:30:40.993510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-295b7c8d-fb20-4f5d-88c1-8ec4c68b63a7 req-62112970-8a4d-496e-994c-4a643c09f51c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:30:41.007466 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-295b7c8d-fb20-4f5d-88c1-8ec4c68b63a7 req-62112970-8a4d-496e-994c-4a643c09f51c service nova] Creating event network-changed:2b9f99a2-35bd-4567-8813-b8ea65fca80b for instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f on hv-cinder-84108 May 09 10:30:41.013706 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-295b7c8d-fb20-4f5d-88c1-8ec4c68b63a7 req-62112970-8a4d-496e-994c-4a643c09f51c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038841 May 09 10:30:41.014510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1714/3429] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:31:39.305689 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:31:39.306585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:31:45.955184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:31:45.955775 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:31:45.962868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:45.963316 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:45.964113 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:45.964573 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:45.990955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-90015faf-357e-41d6-9049-3edb5ec88c25 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/ips" status: 200 len: 150 microversion: 2.1 time: 0.041480 May 09 10:31:45.991669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1716/3430] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 10:31:45 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:31:47.484734 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd51f629-70ce-4bf8-9bd1-8427ff174bbe"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:31:47.486011 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:31:47.493313 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:47.493744 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:47.494569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:47.495009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:47.807610 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f2dbb81-7686-428e-b32e-20f6eff86656 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328224 May 09 10:31:47.808509 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1715/3431] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:31:47 2022] POST /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:31:55.407863 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6c5daf8e-9a2c-443e-8d99-29ad5addee4c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: .version_select at 0x7fa467ef3dc0>, body: {"keypair": {"name": "tempest-keypair-937228658"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:31:55.425232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6c5daf8e-9a2c-443e-8d99-29ad5addee4c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:31:55.430032 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6c5daf8e-9a2c-443e-8d99-29ad5addee4c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:31:55.596057 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6c5daf8e-9a2c-443e-8d99-29ad5addee4c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:31:55.602831 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-6c5daf8e-9a2c-443e-8d99-29ad5addee4c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:31:55.623738 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6c5daf8e-9a2c-443e-8d99-29ad5addee4c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.219539 May 09 10:31:55.624707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1717/3432] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 10:31:55 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:31:57.271158 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1626198744", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bd2fd6b-89d5-4ef4-83f7-9561f023906c"}], "security_groups": [{"name": "tempest-securitygroup--1867969458"}], "key_name": "tempest-keypair-937228658", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:31:57.416312 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] validate_networks() for [('8bd2fd6b-89d5-4ef4-83f7-9561f023906c', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:31:57.872637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:31:57.873552 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:31:57.874498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:31:57.875377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:31:57.877070 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:31:57.889546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:57.890003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:57.890802 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:57.891240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:57.910492 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:31:57.916201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:31:57.930223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:31:57.932777 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:31:57.984402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-2de3160c-deeb-4971-bace-e8e7d272c5c8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723813 May 09 10:31:57.985228 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1716/3433] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:31:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:31:58.001868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-44958903-1828-430a-95e1-d83ee35df830 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:31:58.008816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-44958903-1828-430a-95e1-d83ee35df830 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:31:58.074838 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-44958903-1828-430a-95e1-d83ee35df830 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:31:58.088720 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-44958903-1828-430a-95e1-d83ee35df830 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1241 microversion: 2.1 time: 0.094825 May 09 10:31:58.089645 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1718/3434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:31:57 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:31:59.119374 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:31:59.121765 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:31:59.138625 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:59.139910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:59.142003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:31:59.145657 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:31:59.238133 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:31:59.246810 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-5f468c88-89f9-45f1-bcb4-c1dc774d04d6 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1301 microversion: 2.1 time: 0.135762 May 09 10:31:59.247871 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1717/3435] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:31:59 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1301 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:00.270158 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:00.271884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:00.283427 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:00.284286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:00.287331 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:00.288061 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:00.713884 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:00.724532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-efc8ca80-b27f-4eb9-b6c2-c669d0230fff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.461301 May 09 10:32:00.725691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1719/3436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:00 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:32:01.429510 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-3620a79c-5108-4a02-b690-c874d52150d4 req-79d2c4f7-5862-4a65-bab1-ff6d581f7a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577412ec-a0d1-43cc-978b-e6859e3b3360", "tag": "4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:32:01.462341 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3620a79c-5108-4a02-b690-c874d52150d4 req-79d2c4f7-5862-4a65-bab1-ff6d581f7a03 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:01.463004 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3620a79c-5108-4a02-b690-c874d52150d4 req-79d2c4f7-5862-4a65-bab1-ff6d581f7a03 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:01.479773 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-3620a79c-5108-4a02-b690-c874d52150d4 req-79d2c4f7-5862-4a65-bab1-ff6d581f7a03 service nova] Creating event network-changed:4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f for instance 577412ec-a0d1-43cc-978b-e6859e3b3360 on hv-cinder-84108 May 09 10:32:01.486215 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-3620a79c-5108-4a02-b690-c874d52150d4 req-79d2c4f7-5862-4a65-bab1-ff6d581f7a03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063055 May 09 10:32:01.487088 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1718/3437] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:32:01.751664 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:01.755937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:01.766783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:01.767741 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:01.769318 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:01.770237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:02.135941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:02.145525 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-384318b7-2c27-4ebf-9086-1317d70043c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.401228 May 09 10:32:02.146237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1720/3438] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:01 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:02.499779 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:02.500381 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:02.507499 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:02.507969 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:02.508985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:02.509701 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:02.543333 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:32:02.589248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-7abd9d96-b592-4e20-bee8-92a502680065 req-506afdce-cda8-4c4f-968e-aa30b491b276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:32:02.598042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-7abd9d96-b592-4e20-bee8-92a502680065 req-506afdce-cda8-4c4f-968e-aa30b491b276 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:02.598495 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-7abd9d96-b592-4e20-bee8-92a502680065 req-506afdce-cda8-4c4f-968e-aa30b491b276 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:02.611611 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-7abd9d96-b592-4e20-bee8-92a502680065 req-506afdce-cda8-4c4f-968e-aa30b491b276 service nova] Creating event network-changed:7c0e7067-810f-4deb-ad2e-c6741211f36a for instance dea239ae-edf0-4e2c-882c-eac7762ff254 on hv-cinder-84108 May 09 10:32:02.617791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-7abd9d96-b592-4e20-bee8-92a502680065 req-506afdce-cda8-4c4f-968e-aa30b491b276 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126927 May 09 10:32:02.618403 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1721/3439] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:32:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:32:02.678817 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84f30f09-2cdf-493a-8df9-1ce566afdee5 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 204 len: 0 microversion: 2.1 time: 0.191149 May 09 10:32:02.679890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1719/3440] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:32:02 2022] DELETE /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 09 10:32:02.692446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:02.693348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:02.701529 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:02.702059 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:02.702924 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:02.703479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:02.881706 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:02.896069 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2a917f31-f182-4dff-8ba5-bfba894c1d01 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.207805 May 09 10:32:02.897190 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1722/3441] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:02 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:03.167273 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:03.168077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:03.175328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:03.175813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:03.176604 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:03.177079 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:03.360962 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:03.370623 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f7c4a661-938e-45f7-be08-c6fff512de6e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.206841 May 09 10:32:03.372926 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1720/3442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:03 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:32:03.916176 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:03.916875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:03.924828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:03.925499 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:03.926374 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:03.926852 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:04.079208 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:04.088970 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b879ab85-9d7c-401d-80c2-2af1b071973c tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.177249 May 09 10:32:04.089740 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1723/3443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:03 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:04.393236 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:04.393955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:04.401134 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:04.401632 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:04.402474 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:04.402942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:04.571890 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:04.585995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f450750d-375c-4482-a2d3-072c2c113fba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.197896 May 09 10:32:04.587389 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1721/3444] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:04 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:05.108038 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:05.108717 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:05.116177 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:05.116623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:05.117483 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:05.117916 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:05.281772 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:05.293402 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1b75ba53-8527-4b9c-9bfa-f4c8a5705d03 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.189428 May 09 10:32:05.294479 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1724/3445] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:05 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:05.606603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:05.607549 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:05.615874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:05.616600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:05.617720 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:05.618260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:05.857146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:05.864895 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-aa3116c1-70be-4d37-a954-8503d1e47714 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.264013 May 09 10:32:05.865490 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1722/3446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:05 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:06.318523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:06.319667 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:06.328332 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:06.329070 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:06.330144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:06.331100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:06.521320 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:06.530335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c57f411e-7a14-480c-a0ce-7413259f8606 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1568 microversion: 2.1 time: 0.216347 May 09 10:32:06.531013 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1725/3447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:06 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:32:06.794502 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-680b5550-31fb-43e6-8231-44a4923e2d40 req-2866a22e-83d3-4f4c-880e-17de1c93e446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577412ec-a0d1-43cc-978b-e6859e3b3360", "name": "network-vif-plugged", "status": "completed", "tag": "4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:32:06.806388 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-680b5550-31fb-43e6-8231-44a4923e2d40 req-2866a22e-83d3-4f4c-880e-17de1c93e446 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:06.807164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-680b5550-31fb-43e6-8231-44a4923e2d40 req-2866a22e-83d3-4f4c-880e-17de1c93e446 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:06.831240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-680b5550-31fb-43e6-8231-44a4923e2d40 req-2866a22e-83d3-4f4c-880e-17de1c93e446 service nova] Creating event network-vif-plugged:4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f for instance 577412ec-a0d1-43cc-978b-e6859e3b3360 on hv-cinder-84108 May 09 10:32:06.840046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-89af10f1-74db-4ec4-9733-f6c52ebe5f25 req-70caebf4-5d1f-4bc3-ac50-67d5d93d958d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea239ae-edf0-4e2c-882c-eac7762ff254", "name": "network-vif-deleted", "tag": "7c0e7067-810f-4deb-ad2e-c6741211f36a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:32:06.840813 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-680b5550-31fb-43e6-8231-44a4923e2d40 req-2866a22e-83d3-4f4c-880e-17de1c93e446 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050174 May 09 10:32:06.843335 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1723/3448] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:32:06.851675 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-89af10f1-74db-4ec4-9733-f6c52ebe5f25 req-70caebf4-5d1f-4bc3-ac50-67d5d93d958d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:06.852357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-89af10f1-74db-4ec4-9733-f6c52ebe5f25 req-70caebf4-5d1f-4bc3-ac50-67d5d93d958d service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:06.865136 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-89af10f1-74db-4ec4-9733-f6c52ebe5f25 req-70caebf4-5d1f-4bc3-ac50-67d5d93d958d service nova] Creating event network-vif-deleted:7c0e7067-810f-4deb-ad2e-c6741211f36a for instance dea239ae-edf0-4e2c-882c-eac7762ff254 on hv-cinder-84108 May 09 10:32:06.896469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:06.898640 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-89af10f1-74db-4ec4-9733-f6c52ebe5f25 req-70caebf4-5d1f-4bc3-ac50-67d5d93d958d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080407 May 09 10:32:06.902440 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:06.909989 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:06.910233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1726/3449] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:32:06.910845 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:06.911791 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:06.912370 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:07.130655 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:07.146424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-78d43af9-a057-4187-b001-2b6c5ca7652b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.267187 May 09 10:32:07.157284 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1724/3450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:06 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:07.548847 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:07.549753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:07.556572 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:07.557103 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:07.557919 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:07.558370 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:07.629544 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:07.641307 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1987b9c8-1670-46dd-98ba-276ff9189cd7 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1219 microversion: 2.1 time: 0.096927 May 09 10:32:07.642149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1727/3451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:07 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:08.164340 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:08.165103 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:08.172175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:08.172656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:08.173487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:08.173925 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:08.339491 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:08.348281 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-8f2291a7-6188-431e-8af0-5acb1c4d468e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1367 microversion: 2.1 time: 0.187824 May 09 10:32:08.349032 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1725/3452] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:08 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:08.664875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:08.665562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:08.672895 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:08.673342 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:08.674128 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:08.674560 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:08.711162 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:08.712839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:08.713345 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lazy-loading 'fault' on Instance uuid dea239ae-edf0-4e2c-882c-eac7762ff254 {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:32:08.762357 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffba3643a2b144739316ea0d5a4c01a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b13e936fad64cbcafffb4f896606d4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:08.770391 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-ec89144c-387e-49cb-aa2c-c857516f916e tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 200 len: 1224 microversion: 2.1 time: 0.109636 May 09 10:32:08.771037 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1728/3453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:08 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:09.366207 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:09.366884 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:09.373814 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:09.374260 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:09.375036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:09.375465 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:09.517889 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:32:09.526708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ef3e0ad3-8c11-4f65-85ab-d7faa8ce6ee0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1558 microversion: 2.1 time: 0.164466 May 09 10:32:09.527295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1726/3454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:09 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:32:09.546193 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:09.546966 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:09.556287 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:09.556975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:09.558172 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:09.558828 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:09.646438 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b429e793-2afd-4b3d-9fd0-0fb08b1df11c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106453 May 09 10:32:09.647051 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1729/3455] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 10:32:09 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:32:09.791606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:09.793052 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] [instance: dea239ae-edf0-4e2c-882c-eac7762ff254] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:32:09.802705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:09.803366 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:09.804307 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:09.804910 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:09.824959 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] HTTP exception thrown: Instance dea239ae-edf0-4e2c-882c-eac7762ff254 could not be found. May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Request method failure captured: May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 HTTP/1.1 May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieOxVjcW-cHRM840Z6fYSNugFsnVSq1nXghVkpcyDzYGxyKWrOBoVO0FN2lj0lkxUhWNwaUeMza7gXQLS9MPc5kNenfKGNtT3cUE2Rxnce5R9y4Dys0qRBVdRHABGTC-OyWkf9KqtaqxfZF2i5_atsujOuk7jrx3jNFFfwEX0KcHP0SU May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 7b13e936fad64cbcafffb4f896606d4a May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-TestShelveInstance-442355498 May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:32:09.826836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b13e936fad64cbcafffb4f896606d4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7b13e936fad64cbcafffb4f896606d4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7b13e936fad64cbcafffb4f896606d4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7b13e936fad64cbcafffb4f896606d4a", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-TestShelveInstance-442355498 May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 7b13e936fad64cbcafffb4f896606d4a May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-TestShelveInstance-442355498 May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-TestShelveInstance-442355498-project May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: ffba3643a2b144739316ea0d5a4c01a9 May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-TestShelveInstance-442355498-project May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance dea239ae-edf0-4e2c-882c-eac7762ff254 could not be found. May 09 10:32:09.829762 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'dea239ae-edf0-4e2c-882c-eac7762ff254'} May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea239ae-edf0-4e2c-882c-eac7762ff254 could not be found. May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:32:09.831609 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea239ae-edf0-4e2c-882c-eac7762ff254 could not be found. May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea239ae-edf0-4e2c-882c-eac7762ff254 could not be found. May 09 10:32:09.833915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:32:09.835453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Returning 404 to user: Instance dea239ae-edf0-4e2c-882c-eac7762ff254 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:32:09.835453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-cf2a0061-b39a-4730-82f8-09dac497c796 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254" status: 404 len: 111 microversion: 2.1 time: 0.046236 May 09 10:32:09.835453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1727/3456] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:32:09 2022] GET /compute/v2.1/servers/dea239ae-edf0-4e2c-882c-eac7762ff254 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 09 10:32:10.059753 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2fb040aa-30dd-488b-8a74-890d3904e5f3 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] Calling method '.version_select at 0x7fa467f85af0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:32:10.091832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2fb040aa-30dd-488b-8a74-890d3904e5f3 tempest-TestShelveInstance-442355498 tempest-TestShelveInstance-442355498-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1625543501" status: 202 len: 0 microversion: 2.1 time: 0.040672 May 09 10:32:10.093024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1730/3457] 10.222.0.26 () {58 vars in 1253 bytes} [Mon May 9 10:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1625543501 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:32:11.142535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-69f5671d-89f1-40b7-8b89-29e426636337 req-75314f8d-2a3a-4f45-b9f7-150134547276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "577412ec-a0d1-43cc-978b-e6859e3b3360", "tag": "4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:32:11.158909 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-69f5671d-89f1-40b7-8b89-29e426636337 req-75314f8d-2a3a-4f45-b9f7-150134547276 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:32:11.159469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-69f5671d-89f1-40b7-8b89-29e426636337 req-75314f8d-2a3a-4f45-b9f7-150134547276 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:32:11.174934 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-69f5671d-89f1-40b7-8b89-29e426636337 req-75314f8d-2a3a-4f45-b9f7-150134547276 service nova] Creating event network-changed:4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f for instance 577412ec-a0d1-43cc-978b-e6859e3b3360 on hv-cinder-84108 May 09 10:32:11.181314 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-69f5671d-89f1-40b7-8b89-29e426636337 req-75314f8d-2a3a-4f45-b9f7-150134547276 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044611 May 09 10:32:11.182377 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1728/3458] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:32:20.471111 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:32:20.474247 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:32:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:33:16.092879 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:16.093680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:16.101993 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.102446 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.103256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.103695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.129064 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f540a631-8803-4e8f-9e71-536478f21147 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/ips" status: 200 len: 151 microversion: 2.1 time: 0.043790 May 09 10:33:16.129647 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1731/3459] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 10:33:16 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:33:16.144105 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd51f629-70ce-4bf8-9bd1-8427ff174bbe"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:16.145545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:16.153146 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.153730 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.154766 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.155407 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.262517 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Invalid volume: volume bd51f629-70ce-4bf8-9bd1-8427ff174bbe is already attached to instances: 541672f9-79e5-466b-a3ac-ca41ebba8a0f May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: POST /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/os-volume_attachments HTTP/1.1 May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 74 May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:33:16.264368 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {"volumeAttachment": {"volumeId": "bd51f629-70ce-4bf8-9bd1-8427ff174bbe"}} May 09 10:33:16.265872 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Invalid volume: volume bd51f629-70ce-4bf8-9bd1-8427ff174bbe is already attached to instances: 541672f9-79e5-466b-a3ac-ca41ebba8a0f May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'server_id': '577412ec-a0d1-43cc-978b-e6859e3b3360', 'body': {'volumeAttachment': {'volumeId': 'bd51f629-70ce-4bf8-9bd1-8427ff174bbe'}}} May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bd51f629-70ce-4bf8-9bd1-8427ff174bbe is already attached to instances: 541672f9-79e5-466b-a3ac-ca41ebba8a0f May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:16.266635 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bd51f629-70ce-4bf8-9bd1-8427ff174bbe is already attached to instances: 541672f9-79e5-466b-a3ac-ca41ebba8a0f May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:16.267823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bd51f629-70ce-4bf8-9bd1-8427ff174bbe is already attached to instances: 541672f9-79e5-466b-a3ac-ca41ebba8a0f May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 400 to user: Invalid volume: volume bd51f629-70ce-4bf8-9bd1-8427ff174bbe is already attached to instances: 541672f9-79e5-466b-a3ac-ca41ebba8a0f {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-f1d3d000-b167-412d-a222-8cb1739478b9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129420 May 09 10:33:16.268976 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1729/3460] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:33:16 2022] POST /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:33:16.275444 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:16.275945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:16.283079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.283530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.284325 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.284803 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.324883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:33:16.429470 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-dbc35b40-137b-4b52-801c-5339ce622aeb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 204 len: 0 microversion: 2.1 time: 0.157525 May 09 10:33:16.430109 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1732/3461] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:33:16 2022] DELETE /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:33:16.440827 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:16.441699 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:16.448807 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.449349 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.450159 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:16.450598 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:16.627859 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:16.641276 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-46700cac-8221-4548-b9de-52921fdc2932 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1683 microversion: 2.1 time: 0.205103 May 09 10:33:16.642304 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1730/3462] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:16 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:17.662461 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:17.663535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:17.672589 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:17.673224 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:17.674381 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:17.674945 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:17.836387 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:17.845804 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4778972a-0e79-4099-9e4d-d12ba93f592d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1683 microversion: 2.1 time: 0.188397 May 09 10:33:17.846451 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1733/3463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:17 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:18.866683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:18.867534 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:18.874590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:18.875048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:18.875855 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:18.876294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:19.101451 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:19.110447 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-16205814-0f5e-4316-8a1b-7ebe5326909a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 200 len: 1683 microversion: 2.1 time: 0.248380 May 09 10:33:19.111040 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1731/3464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:18 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 1683 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:19.575293 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-656ca7c8-27a5-42f1-85ff-1fd009f55981 req-5a1b2451-b5f8-4fb6-97ed-063a4924b05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "577412ec-a0d1-43cc-978b-e6859e3b3360", "name": "network-vif-deleted", "tag": "4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:19.599171 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-656ca7c8-27a5-42f1-85ff-1fd009f55981 req-5a1b2451-b5f8-4fb6-97ed-063a4924b05f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:19.599955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-656ca7c8-27a5-42f1-85ff-1fd009f55981 req-5a1b2451-b5f8-4fb6-97ed-063a4924b05f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:19.616161 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-656ca7c8-27a5-42f1-85ff-1fd009f55981 req-5a1b2451-b5f8-4fb6-97ed-063a4924b05f service nova] Creating event network-vif-deleted:4b1c8dc6-9ced-4d0e-95f0-0365c4d2d97f for instance 577412ec-a0d1-43cc-978b-e6859e3b3360 on hv-cinder-84108 May 09 10:33:19.622632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-656ca7c8-27a5-42f1-85ff-1fd009f55981 req-5a1b2451-b5f8-4fb6-97ed-063a4924b05f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053102 May 09 10:33:19.624011 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1734/3465] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:33:20.130710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:20.131554 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:20.138437 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:20.138874 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:20.139875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:20.140545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:20.158020 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 HTTP/1.1 May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:33:20.160269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:33:20.162707 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '577412ec-a0d1-43cc-978b-e6859e3b3360'} May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:33:20.164034 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:33:20.166282 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:33:20.168226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:33:20.168226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-87f149c9-9ea3-4602-8941-422e3b0ff621 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 404 len: 111 microversion: 2.1 time: 0.035053 May 09 10:33:20.168226 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1732/3466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:20 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:33:20.171991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63b078b6-3e2e-4a48-9c69-2ea87a5f3b5b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '.version_select at 0x7fa45ec04b80>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:20.193341 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63b078b6-3e2e-4a48-9c69-2ea87a5f3b5b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-937228658" status: 202 len: 0 microversion: 2.1 time: 0.025570 May 09 10:33:20.194522 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1735/3467] 10.222.0.26 () {58 vars in 1217 bytes} [Mon May 9 10:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-937228658 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:33:21.046364 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:21.046961 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:21.053590 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:21.054208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:21.054945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:21.055383 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:21.158263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lazy-loading 'services' on Instance uuid 541672f9-79e5-466b-a3ac-ca41ebba8a0f {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:33:21.260878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-309afe6b-3e32-4c40-ab3d-feb3cedd43f5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments/bd51f629-70ce-4bf8-9bd1-8427ff174bbe" status: 202 len: 0 microversion: 2.1 time: 0.218639 May 09 10:33:21.261682 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1733/3468] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:33:21 2022] DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments/bd51f629-70ce-4bf8-9bd1-8427ff174bbe => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:33:21.274868 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:21.276535 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:21.289861 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:21.290657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:21.291846 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:21.292421 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:21.336125 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c51c9051-d9c8-45de-a7f7-6178204060fb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069127 May 09 10:33:21.336631 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1736/3469] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:33:21 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:33:22.349798 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:22.350913 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:22.357772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:22.358224 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:22.359009 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:22.359443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:22.391507 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7f5968da-4aa7-48b9-b4ad-d49a3ebca18e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047156 May 09 10:33:22.392057 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1734/3470] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:33:22 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 10:33:22.452286 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:22.453219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:22.460178 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:22.460968 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:22.461758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:22.462195 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:22.490632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:33:22.584843 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-596ecdbd-2720-40e6-a478-f8980c2f2e3c tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 204 len: 0 microversion: 2.1 time: 0.136360 May 09 10:33:22.585976 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1737/3471] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:33:22 2022] DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:33:22.594878 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:22.595822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:22.602641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:22.603099 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:22.603887 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:22.604322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:22.744600 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:22.752850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ba62c6a0-1a45-4d89-9b1c-89ccb8eec596 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1683 microversion: 2.1 time: 0.162029 May 09 10:33:22.753417 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1735/3472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:22 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:33:23.771238 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:23.771950 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:23.779212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:23.779669 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:23.780474 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:23.780951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:23.922765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:23.931581 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9053f9fd-1e45-41b9-9e30-81fac10e6c4e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1683 microversion: 2.1 time: 0.164651 May 09 10:33:23.932184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1738/3473] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:23 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:24.950679 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:24.951664 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:24.959535 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:24.960200 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:24.961449 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:24.962841 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:25.221903 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:25.231524 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-532af242-a6e3-4a00-a821-a7db04f4312b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1683 microversion: 2.1 time: 0.285027 May 09 10:33:25.232239 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1736/3474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:24 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1683 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:25.773222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-478f65eb-5107-49ad-8820-422546cb355a req-dc310957-06a4-437e-8751-14529c381e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541672f9-79e5-466b-a3ac-ca41ebba8a0f", "name": "network-vif-deleted", "tag": "2b9f99a2-35bd-4567-8813-b8ea65fca80b"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:25.790046 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-478f65eb-5107-49ad-8820-422546cb355a req-dc310957-06a4-437e-8751-14529c381e5e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:25.791401 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-478f65eb-5107-49ad-8820-422546cb355a req-dc310957-06a4-437e-8751-14529c381e5e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:25.819189 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-478f65eb-5107-49ad-8820-422546cb355a req-dc310957-06a4-437e-8751-14529c381e5e service nova] Creating event network-vif-deleted:2b9f99a2-35bd-4567-8813-b8ea65fca80b for instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f on hv-cinder-84108 May 09 10:33:25.828644 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-478f65eb-5107-49ad-8820-422546cb355a req-dc310957-06a4-437e-8751-14529c381e5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064493 May 09 10:33:25.830566 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1739/3475] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:33:26.252582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:26.253656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:26.265210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:26.265972 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:26.267651 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:26.268378 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:26.326054 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:26.327212 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:26.328575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lazy-loading 'fault' on Instance uuid 541672f9-79e5-466b-a3ac-ca41ebba8a0f {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:33:26.383498 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:26.395087 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-95c5ecb1-a3f9-4e1b-9910-5bab765cc6b0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 200 len: 1332 microversion: 2.1 time: 0.147406 May 09 10:33:26.396629 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1737/3476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:26 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 1332 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:27.415722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:27.416333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:27.422997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:27.423452 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:27.424241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:27.424700 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:27.439707 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f HTTP/1.1 May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:33:27.441424 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:33:27.445007 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '541672f9-79e5-466b-a3ac-ca41ebba8a0f'} May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:33:27.445870 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:33:27.447327 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:33:27.448540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:33:27.448540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-616e09f4-0873-4a79-ad84-214f94825595 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 404 len: 111 microversion: 2.1 time: 0.032171 May 09 10:33:27.448540 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1740/3477] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:27 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:33:27.453175 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6ce198c8-8914-4437-96c4-04962bc4b366 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '.version_select at 0x7fa45ee6caf0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:27.481680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6ce198c8-8914-4437-96c4-04962bc4b366 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095746231" status: 202 len: 0 microversion: 2.1 time: 0.032389 May 09 10:33:27.483436 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1738/3478] 10.222.0.26 () {58 vars in 1220 bytes} [Mon May 9 10:33:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2095746231 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:33:28.173206 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-136ca4e8-2f7d-460f-b928-a60c29cdaa59 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: .version_select at 0x7fa467ef3dc0>, body: {"keypair": {"name": "tempest-keypair-745535526"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:28.190019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-136ca4e8-2f7d-460f-b928-a60c29cdaa59 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:33:28.194445 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-136ca4e8-2f7d-460f-b928-a60c29cdaa59 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:33:28.339367 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-136ca4e8-2f7d-460f-b928-a60c29cdaa59 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:33:28.344328 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-136ca4e8-2f7d-460f-b928-a60c29cdaa59 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:33:28.360890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-136ca4e8-2f7d-460f-b928-a60c29cdaa59 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.192130 May 09 10:33:28.361562 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1741/3479] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 10:33:28 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:29.908066 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-660995426", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bd2fd6b-89d5-4ef4-83f7-9561f023906c"}], "security_groups": [{"name": "tempest-securitygroup--683861432"}], "key_name": "tempest-keypair-745535526", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:30.045096 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] validate_networks() for [('8bd2fd6b-89d5-4ef4-83f7-9561f023906c', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:33:30.595075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:33:30.595823 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:33:30.596955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:33:30.597703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:33:30.598522 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:33:30.614148 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:30.614938 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:30.616350 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:30.617163 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:30.648446 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:33:30.656525 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:33:30.677025 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:33:30.681431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:33:30.761533 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7e4ee94a-7a56-473e-955d-c5c365266a64 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.860692 May 09 10:33:30.762519 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1739/3480] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:33:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:33:30.775955 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4e55fdef-f005-4fd7-a71c-29422f9d61d8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:30.777120 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4e55fdef-f005-4fd7-a71c-29422f9d61d8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:30.864048 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4e55fdef-f005-4fd7-a71c-29422f9d61d8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:30.874567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4e55fdef-f005-4fd7-a71c-29422f9d61d8 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1240 microversion: 2.1 time: 0.103574 May 09 10:33:30.875447 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1742/3481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:30 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:33:31.895269 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:31.896864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:31.909128 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:31.910003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:31.911012 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:31.911943 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:32.019546 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:32.028441 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-460f9039-4540-4293-922e-d4e61a76e4ff tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1300 microversion: 2.1 time: 0.138261 May 09 10:33:32.029116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1740/3482] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:31 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:33:33.046263 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:33.047089 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:33.054207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:33.054505 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:33.055305 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:33.055737 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:33.219657 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:33.228549 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-176fa343-db08-45d5-91e8-f30f44d1c9c0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.186503 May 09 10:33:33.229219 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1743/3483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:33 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:33.716771 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-b7637bfb-c7c0-4ceb-a339-70992fee42e5 req-6dd5c203-1198-4445-8c17-00ab16466ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61562ee-e344-4975-8faa-a62bbab5b383", "tag": "8f3aa524-3312-47be-aead-f707c4992167"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:33.732875 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b7637bfb-c7c0-4ceb-a339-70992fee42e5 req-6dd5c203-1198-4445-8c17-00ab16466ca7 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:33.733608 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-b7637bfb-c7c0-4ceb-a339-70992fee42e5 req-6dd5c203-1198-4445-8c17-00ab16466ca7 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:33.761822 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-b7637bfb-c7c0-4ceb-a339-70992fee42e5 req-6dd5c203-1198-4445-8c17-00ab16466ca7 service nova] Creating event network-changed:8f3aa524-3312-47be-aead-f707c4992167 for instance c61562ee-e344-4975-8faa-a62bbab5b383 on hv-cinder-84108 May 09 10:33:33.769905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-b7637bfb-c7c0-4ceb-a339-70992fee42e5 req-6dd5c203-1198-4445-8c17-00ab16466ca7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064504 May 09 10:33:33.770949 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1741/3484] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:33:34.248388 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:34.249262 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:34.257010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:34.257510 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:34.258333 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:34.259040 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:34.433192 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:34.443948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-2bfabef2-2d66-4fb3-9bbe-7c5258db104f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.200962 May 09 10:33:34.444710 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1744/3485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:34 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:35.463164 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:35.463864 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:35.470716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:35.471156 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:35.471927 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:35.472357 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:35.628853 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:35.638137 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-23416bed-579e-4816-a39f-09d9d0b1c85f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.180023 May 09 10:33:35.638832 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1742/3486] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:35 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:36.658718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:36.659875 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:36.671602 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:36.672257 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:36.673469 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:36.674188 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:36.842476 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:36.850503 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4daccc4a-d538-4673-af15-69063121a784 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.199003 May 09 10:33:36.851092 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1745/3487] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:36 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:37.872295 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:37.873356 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:37.884280 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:37.885111 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:37.886453 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:37.887213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:38.070914 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:38.084153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e16d4e3e-a71f-45ea-95c7-522a96befc6d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.218626 May 09 10:33:38.085160 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1743/3488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:37 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:39.103477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:39.104115 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:39.111232 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:39.111718 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:39.112530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:39.113019 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:39.278074 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:39.289325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-535c6ca4-764f-4a57-b11c-ff4695bab338 req-aaf7867d-0cf3-48ce-af39-0782c7879468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61562ee-e344-4975-8faa-a62bbab5b383", "name": "network-vif-plugged", "status": "completed", "tag": "8f3aa524-3312-47be-aead-f707c4992167"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:39.291734 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-d2628222-f374-490a-b63e-38be00361602 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.191884 May 09 10:33:39.292819 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1746/3489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:39 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:39.311503 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-535c6ca4-764f-4a57-b11c-ff4695bab338 req-aaf7867d-0cf3-48ce-af39-0782c7879468 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:39.311951 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-535c6ca4-764f-4a57-b11c-ff4695bab338 req-aaf7867d-0cf3-48ce-af39-0782c7879468 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:39.329885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-535c6ca4-764f-4a57-b11c-ff4695bab338 req-aaf7867d-0cf3-48ce-af39-0782c7879468 service nova] Creating event network-vif-plugged:8f3aa524-3312-47be-aead-f707c4992167 for instance c61562ee-e344-4975-8faa-a62bbab5b383 on hv-cinder-84108 May 09 10:33:39.336987 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-535c6ca4-764f-4a57-b11c-ff4695bab338 req-aaf7867d-0cf3-48ce-af39-0782c7879468 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051508 May 09 10:33:39.337624 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1744/3490] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:33:40.316024 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:40.317021 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:40.324405 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:40.324959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:40.325842 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:40.326323 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:40.469696 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:40.478000 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-754c5570-9366-4657-a954-4ebf94b48baf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1365 microversion: 2.1 time: 0.165870 May 09 10:33:40.478616 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1747/3491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:40 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:41.496513 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:41.497263 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:41.504881 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:41.505322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:41.506147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:41.506603 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:41.670186 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:33:41.679223 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3a397e7a-d199-48fd-87bb-7f957be47318 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1556 microversion: 2.1 time: 0.187161 May 09 10:33:41.679820 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1745/3492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:33:41 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:33:41.707853 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:33:41.708858 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:33:41.721150 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:41.721892 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:41.723212 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:41.723973 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:41.816606 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-5238a890-0481-48e5-bed3-1fd37d5e96bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115853 May 09 10:33:41.817632 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1748/3493] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 10:33:41 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:33:43.240532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-f171b95b-8cf7-42df-9cac-cd2e81aac9cc req-71002d85-3392-4f0e-8208-195b230d169e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61562ee-e344-4975-8faa-a62bbab5b383", "tag": "8f3aa524-3312-47be-aead-f707c4992167"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:33:43.256529 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f171b95b-8cf7-42df-9cac-cd2e81aac9cc req-71002d85-3392-4f0e-8208-195b230d169e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:33:43.257343 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-f171b95b-8cf7-42df-9cac-cd2e81aac9cc req-71002d85-3392-4f0e-8208-195b230d169e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:33:43.278361 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-f171b95b-8cf7-42df-9cac-cd2e81aac9cc req-71002d85-3392-4f0e-8208-195b230d169e service nova] Creating event network-changed:8f3aa524-3312-47be-aead-f707c4992167 for instance c61562ee-e344-4975-8faa-a62bbab5b383 on hv-cinder-84108 May 09 10:33:43.287401 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-f171b95b-8cf7-42df-9cac-cd2e81aac9cc req-71002d85-3392-4f0e-8208-195b230d169e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053596 May 09 10:33:43.288443 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1746/3494] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:34:46.830759 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:46.831456 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:46.837781 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:46.838276 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:46.839106 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:46.839638 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:46.866395 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-9f2d2878-6c3c-4a35-8142-a37afefe5dfc tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/ips" status: 200 len: 151 microversion: 2.1 time: 0.041337 May 09 10:34:46.867014 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1749/3495] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 10:34:46 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:34:48.258143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ccb58c-9f41-4f92-84ca-a43e177bf8bf"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:34:48.260264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:48.270942 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:48.271582 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:48.272837 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:48.273528 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:48.562272 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9ab2841a-cd38-4889-ae93-b3be42a358ba tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312355 May 09 10:34:48.562424 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1747/3496] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:34:48 2022] POST /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:34:56.118625 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ccb58c-9f41-4f92-84ca-a43e177bf8bf"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:34:56.120957 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:56.132170 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:56.132990 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:56.134386 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:56.135153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:56.237281 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Invalid volume: volume d9ccb58c-9f41-4f92-84ca-a43e177bf8bf is already attached to instances: c61562ee-e344-4975-8faa-a62bbab5b383 May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: POST /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments HTTP/1.1 May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 74 May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:34:56.238907 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {"volumeAttachment": {"volumeId": "d9ccb58c-9f41-4f92-84ca-a43e177bf8bf"}} May 09 10:34:56.240547 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Invalid volume: volume d9ccb58c-9f41-4f92-84ca-a43e177bf8bf is already attached to instances: c61562ee-e344-4975-8faa-a62bbab5b383 May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'server_id': 'c61562ee-e344-4975-8faa-a62bbab5b383', 'body': {'volumeAttachment': {'volumeId': 'd9ccb58c-9f41-4f92-84ca-a43e177bf8bf'}}} May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d9ccb58c-9f41-4f92-84ca-a43e177bf8bf is already attached to instances: c61562ee-e344-4975-8faa-a62bbab5b383 May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:34:56.244184 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d9ccb58c-9f41-4f92-84ca-a43e177bf8bf is already attached to instances: c61562ee-e344-4975-8faa-a62bbab5b383 May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:34:56.245360 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d9ccb58c-9f41-4f92-84ca-a43e177bf8bf is already attached to instances: c61562ee-e344-4975-8faa-a62bbab5b383 May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 400 to user: Invalid volume: volume d9ccb58c-9f41-4f92-84ca-a43e177bf8bf is already attached to instances: c61562ee-e344-4975-8faa-a62bbab5b383 {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-1fe32c97-8f0a-44d9-b789-4652b4e177bb tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129292 May 09 10:34:56.246533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1750/3497] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:34:56 2022] POST /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 09 10:34:56.324216 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:56.324917 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:56.331752 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:56.332209 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:56.333036 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:56.333471 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:56.419310 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lazy-loading 'services' on Instance uuid c61562ee-e344-4975-8faa-a62bbab5b383 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:34:56.495905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3faf9604-1a80-4143-9a0d-b30b702a3cd0 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments/d9ccb58c-9f41-4f92-84ca-a43e177bf8bf" status: 202 len: 0 microversion: 2.1 time: 0.175938 May 09 10:34:56.497037 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1748/3498] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:34:56 2022] DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments/d9ccb58c-9f41-4f92-84ca-a43e177bf8bf => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:34:56.506894 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:56.507941 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:56.514649 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:56.515203 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:56.516315 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:56.516927 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:56.562004 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c2e04ed5-0f89-4ce8-9cb1-f9c9d1857463 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059789 May 09 10:34:56.562599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1751/3499] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:34:56 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:34:57.576145 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:57.577915 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:57.585630 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:57.586075 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:57.586932 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:57.587418 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:57.635638 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-099acee9-39af-41e1-99a5-d7eddad66694 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064299 May 09 10:34:57.636704 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1749/3500] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:34:57 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 10:34:57.703058 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:57.703723 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:57.711030 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:57.711487 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:57.712303 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:57.712791 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:57.755691 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Going to try to terminate instance {{(pid=123637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:34:57.869603 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-7069b2ea-eb51-4963-bfe4-c2a459142431 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 204 len: 0 microversion: 2.1 time: 0.169754 May 09 10:34:57.870508 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1752/3501] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:34:57 2022] DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:34:57.879980 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:57.880816 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:57.888010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:57.888469 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:57.889325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:57.889767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:58.055900 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:34:58.065431 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-763a1689-100d-4461-9ec3-b859a56c103d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1681 microversion: 2.1 time: 0.189403 May 09 10:34:58.066126 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1750/3502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:34:57 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:34:59.093079 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:34:59.093796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:34:59.101245 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:59.101770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:59.102681 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:34:59.103209 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:34:59.262533 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:34:59.276151 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a180b122-41a4-447b-8aa4-248e1a12f5ee tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1681 microversion: 2.1 time: 0.187639 May 09 10:34:59.277221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1753/3503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:34:59 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:00.302767 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:00.303921 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:00.313347 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:00.313940 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:00.315086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:00.315825 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:00.631539 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:00.645262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-7ae00b01-53e2-4498-a2c3-cb9fd7cb89ca tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1681 microversion: 2.1 time: 0.346354 May 09 10:35:00.646292 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1751/3504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:00 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1681 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:01.404023 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-c6c1b979-4b82-42b3-aec9-5bb66b3ba6e6 req-bd036429-1564-4161-a5f5-faf4d1832639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61562ee-e344-4975-8faa-a62bbab5b383", "name": "network-vif-deleted", "tag": "8f3aa524-3312-47be-aead-f707c4992167"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:35:01.414237 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c6c1b979-4b82-42b3-aec9-5bb66b3ba6e6 req-bd036429-1564-4161-a5f5-faf4d1832639 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:01.415124 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-c6c1b979-4b82-42b3-aec9-5bb66b3ba6e6 req-bd036429-1564-4161-a5f5-faf4d1832639 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:01.437652 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-c6c1b979-4b82-42b3-aec9-5bb66b3ba6e6 req-bd036429-1564-4161-a5f5-faf4d1832639 service nova] Creating event network-vif-deleted:8f3aa524-3312-47be-aead-f707c4992167 for instance c61562ee-e344-4975-8faa-a62bbab5b383 on hv-cinder-84108 May 09 10:35:01.443363 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-c6c1b979-4b82-42b3-aec9-5bb66b3ba6e6 req-bd036429-1564-4161-a5f5-faf4d1832639 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043334 May 09 10:35:01.444541 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1754/3505] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:35:01.669104 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:01.669702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:01.676483 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:01.676975 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:01.677772 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:01.678208 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:01.713182 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:01.713637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:01.714092 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.objects.instance [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lazy-loading 'fault' on Instance uuid c61562ee-e344-4975-8faa-a62bbab5b383 {{(pid=123638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:35:01.758870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:01.767108 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-04fa5e4f-93c0-4c70-bc1c-065e9e1dafc9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 200 len: 1330 microversion: 2.1 time: 0.101962 May 09 10:35:01.767680 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1752/3506] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:01 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:02.785934 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:02.786688 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:02.794311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:02.794758 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:02.795545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:02.795972 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:02.813330 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 HTTP/1.1 May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:35:02.816241 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:35:02.818538 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'c61562ee-e344-4975-8faa-a62bbab5b383'} May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:35:02.819849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:35:02.822031 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:35:02.824297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:35:02.824297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-8382246d-a462-4a0b-81cb-6fc873cfb197 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 404 len: 111 microversion: 2.1 time: 0.036940 May 09 10:35:02.824297 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1755/3507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:02 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:35:02.829404 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-ce440bbe-df7e-40db-b30c-eb50c0596e1e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '.version_select at 0x7fa45ed96dc0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:02.850543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-ce440bbe-df7e-40db-b30c-eb50c0596e1e tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-745535526" status: 202 len: 0 microversion: 2.1 time: 0.025068 May 09 10:35:02.851098 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1753/3508] 10.222.0.26 () {58 vars in 1217 bytes} [Mon May 9 10:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-745535526 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:35:03.570605 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f54f7b9d-56eb-4887-b3a6-502faaa6f5c9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: .version_select at 0x7fa45edac160>, body: {"keypair": {"name": "tempest-keypair-824231000"}} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:35:03.586639 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f54f7b9d-56eb-4887-b3a6-502faaa6f5c9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:35:03.591565 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f54f7b9d-56eb-4887-b3a6-502faaa6f5c9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:35:03.822473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f54f7b9d-56eb-4887-b3a6-502faaa6f5c9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:35:03.827784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.quota [None req-f54f7b9d-56eb-4887-b3a6-502faaa6f5c9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'key_pairs'} {{(pid=123637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:35:03.844107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f54f7b9d-56eb-4887-b3a6-502faaa6f5c9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.277494 May 09 10:35:03.844836 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1756/3509] 10.222.0.26 () {60 vars in 1157 bytes} [Mon May 9 10:35:03 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:05.370687 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2055549686", "imageRef": "1cc6f183-cf0c-48b6-8578-3bd22df1927e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bd2fd6b-89d5-4ef4-83f7-9561f023906c"}], "security_groups": [{"name": "tempest-securitygroup--713846320"}], "key_name": "tempest-keypair-824231000", "user_data": "}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:35:05.510955 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.network.neutron [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] validate_networks() for [('8bd2fd6b-89d5-4ef4-83f7-9561f023906c', None, None, None, None, None)] {{(pid=123638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 09 10:35:05.941842 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 09 10:35:05.942322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image limits 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 09 10:35:05.942870 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Flavor pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 09 10:35:05.943326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Image pref 0:0:0 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 09 10:35:05.943784 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.virt.hardware [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 09 10:35:05.955116 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:05.955562 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:05.956339 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:05.956830 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:05.975663 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 09 10:35:05.981264 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.quota [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Getting quotas for user a5732efd025843a28c9b6948b4b893f5 and project 6747c07e670e4379874273bc5a88397f. Resources: {'cores', 'instances', 'ram'} {{(pid=123638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 09 10:35:05.995386 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Going to run 1 instances... {{(pid=123638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 09 10:35:05.997785 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1cc6f183-cf0c-48b6-8578-3bd22df1927e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 09 10:35:06.058147 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-00ff5508-4af9-44ed-b69f-4486b05f273d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.692719 May 09 10:35:06.058828 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1754/3510] 10.222.0.26 () {60 vars in 1146 bytes} [Mon May 9 10:35:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 09 10:35:06.070430 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b086e125-159f-4a4b-b9ef-b491ac000297 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:06.071765 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b086e125-159f-4a4b-b9ef-b491ac000297 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:06.150822 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-b086e125-159f-4a4b-b9ef-b491ac000297 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:06.159504 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b086e125-159f-4a4b-b9ef-b491ac000297 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1241 microversion: 2.1 time: 0.093360 May 09 10:35:06.160339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1757/3511] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:06 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:35:07.181319 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:07.182157 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:07.191010 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:07.191656 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:07.192649 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:07.193178 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:07.283756 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:07.296130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-e40ad70c-c652-40fb-8527-9c90de7d247b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1293 microversion: 2.1 time: 0.119861 May 09 10:35:07.297545 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1755/3512] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:07 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1293 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:08.315537 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:08.316355 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:08.326481 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:08.327650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:08.329951 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:08.330722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:08.547234 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:08.557905 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-444ec27e-e449-4b71-b415-76b63561fc41 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.246358 May 09 10:35:08.558789 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1758/3513] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:08 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:35:09.243912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-2daa9a71-ee06-4955-986a-28de956521bb req-bc5e5bd7-8d1f-401f-b280-af2b96f4924e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5220ac22-0bcd-4b35-8ee8-f479e9d8784d", "tag": "14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:35:09.295847 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-2daa9a71-ee06-4955-986a-28de956521bb req-bc5e5bd7-8d1f-401f-b280-af2b96f4924e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:09.297290 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-2daa9a71-ee06-4955-986a-28de956521bb req-bc5e5bd7-8d1f-401f-b280-af2b96f4924e service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:09.315240 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-2daa9a71-ee06-4955-986a-28de956521bb req-bc5e5bd7-8d1f-401f-b280-af2b96f4924e service nova] Creating event network-changed:14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a for instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d on hv-cinder-84108 May 09 10:35:09.323001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-2daa9a71-ee06-4955-986a-28de956521bb req-bc5e5bd7-8d1f-401f-b280-af2b96f4924e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088297 May 09 10:35:09.324346 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1756/3514] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:35:09.576221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:09.577288 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:09.585609 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:09.586207 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:09.587041 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:09.587593 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:09.947134 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:09.960643 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-c29eb441-e299-461c-88df-7fa912666350 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.388519 May 09 10:35:09.961683 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1759/3515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:09 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 09 10:35:10.980397 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:10.981153 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:10.988876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:10.989352 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:10.990135 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:10.990597 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:11.161782 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:11.170595 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-0d3c6dbd-2aa0-4b18-8a40-a2897ba4a924 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.195339 May 09 10:35:11.171213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1757/3516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:10 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:12.189454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:12.190376 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:12.202149 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:12.202948 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:12.203982 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:12.204484 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:12.398912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:12.412256 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e5223506-d629-42c1-be16-2bd2eccca208 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.227873 May 09 10:35:12.413012 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1760/3517] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:12 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:13.430306 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:13.430958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:13.442565 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:13.445857 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:13.446769 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:13.447439 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:13.668569 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:13.683643 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-d6d63d05-3c35-4100-a684-9cefb9f0b0de tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.257146 May 09 10:35:13.684647 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1758/3518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:13 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:13.862123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [req-5b8ab776-bec3-46fc-a301-d23a5452bcca req-ccd1113b-f034-49bd-9680-c3066faa524c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5220ac22-0bcd-4b35-8ee8-f479e9d8784d", "name": "network-vif-plugged", "status": "completed", "tag": "14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a"}]} {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:35:13.873725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5b8ab776-bec3-46fc-a301-d23a5452bcca req-ccd1113b-f034-49bd-9680-c3066faa524c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:13.874222 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [req-5b8ab776-bec3-46fc-a301-d23a5452bcca req-ccd1113b-f034-49bd-9680-c3066faa524c service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:13.886903 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.compute.server_external_events [req-5b8ab776-bec3-46fc-a301-d23a5452bcca req-ccd1113b-f034-49bd-9680-c3066faa524c service nova] Creating event network-vif-plugged:14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a for instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d on hv-cinder-84108 May 09 10:35:13.892515 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [req-5b8ab776-bec3-46fc-a301-d23a5452bcca req-ccd1113b-f034-49bd-9680-c3066faa524c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136902 May 09 10:35:13.893324 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1761/3519] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:35:14.702479 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:14.703322 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:14.710543 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:14.711003 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:14.711804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:14.712246 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:14.863155 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:14.872323 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d55f660-6027-4be7-a8b2-ba1534af4056 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.173746 May 09 10:35:14.873058 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1759/3520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:14 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:15.893215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:15.894459 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:15.905623 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:15.906502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:15.907937 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:15.908786 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:16.091621 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:16.100319 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-27938c2f-aefa-44cc-83a9-5b67922293fe tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1366 microversion: 2.1 time: 0.213435 May 09 10:35:16.100959 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1762/3521] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:15 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:17.121717 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:17.122861 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:17.134327 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:17.135139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:17.136487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:17.137188 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:17.311912 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:35:17.320202 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-115046e6-c1c5-4b26-993e-0ea7cce888c5 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1556 microversion: 2.1 time: 0.205559 May 09 10:35:17.320836 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1760/3522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:35:17 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:35:17.341614 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:35:17.342682 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:35:17.354294 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:17.355105 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:17.356477 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:17.357255 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:17.465215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bfe30bb2-dba3-4a79-8b52-eba4a8c67a07 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130819 May 09 10:35:17.465975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1763/3523] 10.222.0.26 () {58 vars in 1274 bytes} [Mon May 9 10:35:17 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:35:18.671325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-3d130b64-5d74-4fea-85fd-bf1eb45dbaed req-a213ee04-8770-47d5-a4cb-8b8da0c20a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5220ac22-0bcd-4b35-8ee8-f479e9d8784d", "tag": "14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:35:18.680869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3d130b64-5d74-4fea-85fd-bf1eb45dbaed req-a213ee04-8770-47d5-a4cb-8b8da0c20a4f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:35:18.681438 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3d130b64-5d74-4fea-85fd-bf1eb45dbaed req-a213ee04-8770-47d5-a4cb-8b8da0c20a4f service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:35:18.695330 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-3d130b64-5d74-4fea-85fd-bf1eb45dbaed req-a213ee04-8770-47d5-a4cb-8b8da0c20a4f service nova] Creating event network-changed:14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a for instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d on hv-cinder-84108 May 09 10:35:18.701637 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-3d130b64-5d74-4fea-85fd-bf1eb45dbaed req-a213ee04-8770-47d5-a4cb-8b8da0c20a4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127276 May 09 10:35:18.702567 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1761/3524] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:35:40.481552 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:35:40.482380 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:35:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:36:23.462449 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:23.463148 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:23.469770 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:23.470577 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:23.471375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:23.471839 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:23.499991 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-fc807e2d-dbd2-43d0-86ea-bb785802ff4f tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/ips" status: 200 len: 149 microversion: 2.1 time: 0.110829 May 09 10:36:23.500559 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1764/3525] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 10:36:23 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/ips => generated 149 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:36:24.867197 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afeb2404-e0a1-4752-bc92-d5fc55def1c1"}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:36:24.868376 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:24.875275 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:24.875731 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:24.876487 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:24.876979 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:25.173403 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-64759caa-f6c8-462c-9ab5-0457d333f763 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "POST /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312674 May 09 10:36:25.174143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1762/3526] 10.222.0.26 () {60 vars in 1322 bytes} [Mon May 9 10:36:24 2022] POST /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:36:32.943339 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:32.943964 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:32.951231 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:32.951680 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:32.952485 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:32.952954 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:33.049010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lazy-loading 'services' on Instance uuid 5220ac22-0bcd-4b35-8ee8-f479e9d8784d {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:36:33.138816 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-63669f35-35e4-4ea8-a9ff-c7efa0516073 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments/afeb2404-e0a1-4752-bc92-d5fc55def1c1" status: 202 len: 0 microversion: 2.1 time: 0.199483 May 09 10:36:33.139490 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1765/3527] 10.222.0.26 () {58 vars in 1415 bytes} [Mon May 9 10:36:32 2022] DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments/afeb2404-e0a1-4752-bc92-d5fc55def1c1 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 09 10:36:33.152703 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:33.154170 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:33.165639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:33.166201 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:33.167130 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:33.167721 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:33.211008 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-637327c2-c523-421b-8af6-e8e1716b9bb9 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064406 May 09 10:36:33.211592 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1763/3528] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:36:33 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 09 10:36:34.224519 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:34.225790 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:34.233439 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:34.233897 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:34.234703 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:34.235144 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:34.268404 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-6b2c4792-9f76-452e-b4f4-241ea441180a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048904 May 09 10:36:34.269025 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1766/3529] 10.222.0.26 () {58 vars in 1301 bytes} [Mon May 9 10:36:34 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 09 10:36:34.339326 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:34.340022 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:34.347421 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:34.347922 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:34.348789 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:34.349235 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:34.377570 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Going to try to terminate instance {{(pid=123638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 09 10:36:34.468702 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6a094866-15e0-4ac8-a3e7-146d115aafc7 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 204 len: 0 microversion: 2.1 time: 0.133566 May 09 10:36:34.469382 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1764/3530] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:36:34 2022] DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 09 10:36:34.479887 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:34.480597 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:34.487650 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:34.488100 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:34.488931 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:34.489398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:34.639252 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:36:34.647530 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-225d198c-6627-46bf-b46f-29d8a4fd5865 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1680 microversion: 2.1 time: 0.172585 May 09 10:36:34.648160 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1767/3531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:34 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:36:35.666732 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:35.667328 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:35.674564 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:35.675001 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:35.675805 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:35.676244 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:35.831413 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.policy [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123638) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:36:35.840086 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-1d309c71-324e-4e54-ae8f-c8f75a81fd08 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1680 microversion: 2.1 time: 0.177784 May 09 10:36:35.840715 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1765/3532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:35 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:36:36.862200 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:36.863329 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:36.874591 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:36.875336 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:36.876890 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:36.877599 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:37.058107 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:36:37.072129 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-a6420e96-8154-430c-acfd-8f19000df3c1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1680 microversion: 2.1 time: 0.216538 May 09 10:36:37.073221 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1768/3533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:36 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:36:37.731705 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [req-3f658ac1-416d-49cf-b35f-dfe24d4ffe44 req-7c2ceeca-769f-41f5-a65f-3b1c9a22e2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5220ac22-0bcd-4b35-8ee8-f479e9d8784d", "name": "network-vif-deleted", "tag": "14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a"}]} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:36:37.759530 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3f658ac1-416d-49cf-b35f-dfe24d4ffe44 req-7c2ceeca-769f-41f5-a65f-3b1c9a22e2e3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:37.759908 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [req-3f658ac1-416d-49cf-b35f-dfe24d4ffe44 req-7c2ceeca-769f-41f5-a65f-3b1c9a22e2e3 service nova] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:37.791639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.compute.server_external_events [req-3f658ac1-416d-49cf-b35f-dfe24d4ffe44 req-7c2ceeca-769f-41f5-a65f-3b1c9a22e2e3 service nova] Creating event network-vif-deleted:14b2fee6-14ac-4506-9d5b-9f1d5ac0e80a for instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d on hv-cinder-84108 May 09 10:36:37.803121 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [req-3f658ac1-416d-49cf-b35f-dfe24d4ffe44 req-7c2ceeca-769f-41f5-a65f-3b1c9a22e2e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077691 May 09 10:36:37.811082 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1766/3534] 10.222.0.26 () {64 vars in 1317 bytes} [Mon May 9 10:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:36:38.099348 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:38.100335 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:38.108849 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:38.109534 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:38.110475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:38.111233 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:38.151810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:38.152900 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:38.156726 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.objects.instance [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lazy-loading 'fault' on Instance uuid 5220ac22-0bcd-4b35-8ee8-f479e9d8784d {{(pid=123637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 09 10:36:38.216760 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.policy [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5732efd025843a28c9b6948b4b893f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6747c07e670e4379874273bc5a88397f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123637) authorize /opt/stack/nova/nova/policy.py:199}} May 09 10:36:38.230860 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-e555fc46-636f-4ed5-8bf3-56892c024490 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 200 len: 1331 microversion: 2.1 time: 0.136289 May 09 10:36:38.231912 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1769/3535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:38 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 09 10:36:39.256406 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:39.257177 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:39.264402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:39.264905 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:39.265712 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:39.266191 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:39.282532 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d HTTP/1.1 May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:36:39.284558 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:39.287213 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '5220ac22-0bcd-4b35-8ee8-f479e9d8784d'} May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:39.288536 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:39.291006 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:39.293759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:39.293759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-84f0863c-c056-4973-89ba-4414dae3c26b tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 404 len: 111 microversion: 2.1 time: 0.035053 May 09 10:36:39.293759 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1767/3536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:39 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:39.297389 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-bfb22d8d-2ace-48ca-a963-154530b1d035 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '.version_select at 0x7fa467fe3790>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:39.325002 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-bfb22d8d-2ace-48ca-a963-154530b1d035 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-824231000" status: 202 len: 0 microversion: 2.1 time: 0.031789 May 09 10:36:39.325610 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1770/3537] 10.222.0.26 () {58 vars in 1217 bytes} [Mon May 9 10:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-824231000 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:36:41.412641 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:41.413337 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:41.420325 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:41.420901 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:41.421710 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:41.422210 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:41.437299 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d HTTP/1.1 May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:36:41.438886 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.441394 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '5220ac22-0bcd-4b35-8ee8-f479e9d8784d'} May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:41.442757 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.445232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:41.447749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:41.447749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-eb10b89c-2d99-4b14-84df-85a8f5144515 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 404 len: 111 microversion: 2.1 time: 0.031634 May 09 10:36:41.447749 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1768/3538] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:36:41 2022] DELETE /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:41.451475 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:41.452501 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 5220ac22-0bcd-4b35-8ee8-f479e9d8784d] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:41.459784 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:41.460292 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:41.461165 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:41.461674 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:41.477194 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d HTTP/1.1 May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:36:41.478975 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.481123 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '5220ac22-0bcd-4b35-8ee8-f479e9d8784d'} May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:41.482433 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. May 09 10:36:41.484523 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:41.486812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 5220ac22-0bcd-4b35-8ee8-f479e9d8784d could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:41.486812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f410b610-efff-46e4-80f1-fd8df7be7242 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d" status: 404 len: 111 microversion: 2.1 time: 0.035262 May 09 10:36:41.486812 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1771/3539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:41 2022] GET /compute/v2.1/servers/5220ac22-0bcd-4b35-8ee8-f479e9d8784d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:42.637808 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:42.638753 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:42.646059 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.646508 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.647301 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.647729 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.663456 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 HTTP/1.1 May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:36:42.665077 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.667285 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': 'c61562ee-e344-4975-8faa-a62bbab5b383'} May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:42.668606 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.670639 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.672869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:42.672869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-526019e4-9fa6-4ad2-9c3e-9a93e66ebcdf tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 404 len: 111 microversion: 2.1 time: 0.033496 May 09 10:36:42.672869 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1769/3540] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:36:42 2022] DELETE /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:42.677898 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:42.678567 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: c61562ee-e344-4975-8faa-a62bbab5b383] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:42.685545 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.686083 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.687039 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.687546 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.702724 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 HTTP/1.1 May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:36:42.704426 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.706661 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': 'c61562ee-e344-4975-8faa-a62bbab5b383'} May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:42.707979 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. May 09 10:36:42.709997 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.711502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance c61562ee-e344-4975-8faa-a62bbab5b383 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:42.711502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-3469ba65-7179-4822-8fd0-6a8ccbea5eaa tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383" status: 404 len: 111 microversion: 2.1 time: 0.032175 May 09 10:36:42.711502 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1772/3541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:42 2022] GET /compute/v2.1/servers/c61562ee-e344-4975-8faa-a62bbab5b383 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:42.719106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:42.719967 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:42.730911 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.731708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.733100 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.733876 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.752300 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 HTTP/1.1 May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:36:42.753945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.756488 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '577412ec-a0d1-43cc-978b-e6859e3b3360'} May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:42.757986 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.760620 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:42.762995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:42.762995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-4680f2a6-ac68-47c0-a2fd-1f52a1f27d4d tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 404 len: 111 microversion: 2.1 time: 0.043651 May 09 10:36:42.762995 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1770/3542] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:36:42 2022] DELETE /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:42.764783 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:42.765410 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 577412ec-a0d1-43cc-978b-e6859e3b3360] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:42.772006 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.772454 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.773280 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:42.773722 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:42.790526 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 HTTP/1.1 May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:36:42.792133 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.794375 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '577412ec-a0d1-43cc-978b-e6859e3b3360'} May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:42.795153 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. May 09 10:36:42.796409 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:42.797532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 577412ec-a0d1-43cc-978b-e6859e3b3360 could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:42.797532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-f5ebfe55-ea8f-440b-be6d-e68ecd91170a tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360" status: 404 len: 111 microversion: 2.1 time: 0.032808 May 09 10:36:42.797532 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1773/3543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:42 2022] GET /compute/v2.1/servers/577412ec-a0d1-43cc-978b-e6859e3b3360 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:43.954106 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:43.955000 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.compute.api [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123638) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:43.962139 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:43.962579 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:43.963379 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:43.963806 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG oslo_concurrency.lockutils [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:43.978985 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f HTTP/1.1 May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:36:43.980683 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: > May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:43.982804 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '541672f9-79e5-466b-a3ac-ca41ebba8a0f'} May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:43.984026 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:43.986195 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:43.988262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:43.988262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-6defe349-2ab2-4f3d-991b-5ad42be37cb1 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 404 len: 111 microversion: 2.1 time: 0.033059 May 09 10:36:43.988262 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1771/3544] 10.222.0.26 () {58 vars in 1238 bytes} [Mon May 9 10:36:43 2022] DELETE /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:43.993796 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Calling method '>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:43.994450 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.compute.api [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] [instance: 541672f9-79e5-466b-a3ac-ca41ebba8a0f] Fetching instance by UUID {{(pid=123637) get /opt/stack/nova/nova/compute/api.py:2920}} May 09 10:36:44.002020 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:44.002473 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:44.003311 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 09 10:36:44.003725 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG oslo_concurrency.lockutils [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Lock "d3fa34f5-2fe2-4198-819d-4854c40b59aa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 09 10:36:44.018911 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.wsgi [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] HTTP exception thrown: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Request method failure captured: May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: request: GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f HTTP/1.1 May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept: application/json May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Accept-Encoding: identity May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Connection: close May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Length: 0 May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Content-Type: application/json May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Host: 10.222.0.26 May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Openstack-System-Scope: None May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: User-Agent: python-urllib3/1.26.9 May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Auth-Token: gAAAAABieO0_246pgFmuavP-_kPU_8_MZoSfyMXyDJPpV7ZCcN_BlgHrkyvUburhe34cyWTwHi3YeMlOHLGAftvYy1a0AuQUcUZ9ITVl88XQvs0xZ1ziQZYjlcnwlLvoDIy9P8k-Fx1Qv8_B6XfCWfr0GFxY1T4ECuzX_TAdVQ033dLJVrx9tTY May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Id: None May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Domain-Name: None May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Identity-Status: Confirmed May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Is-Admin-Project: True May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Id: default May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Domain-Name: Default May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Project-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Role: member,reader May 09 10:36:44.020478 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Roles: member,reader May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6747c07e670e4379874273bc5a88397f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6747c07e670e4379874273bc5a88397f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6747c07e670e4379874273bc5a88397f", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Id: 6747c07e670e4379874273bc5a88397f May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-265068941 May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Id: default May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Domain-Name: Default May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Id: a5732efd025843a28c9b6948b4b893f5 May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: X-User-Name: tempest-AttachVolumeNegativeTest-265068941-project May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: method: > May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: exception: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:44.022699 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: action_args: {'id': '541672f9-79e5-466b-a3ac-ca41ebba8a0f'} May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:44.024215 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. May 09 10:36:44.026666 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: ERROR nova.api.openstack.wsgi May 09 10:36:44.028832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] Returning 404 to user: Instance 541672f9-79e5-466b-a3ac-ca41ebba8a0f could not be found. {{(pid=123637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:44.028832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-b98e9032-251d-4c8d-a485-852999eeb168 tempest-AttachVolumeNegativeTest-265068941 tempest-AttachVolumeNegativeTest-265068941-project] 10.222.0.26 "GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f" status: 404 len: 111 microversion: 2.1 time: 0.032158 May 09 10:36:44.028832 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1774/3545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon May 9 10:36:43 2022] GET /compute/v2.1/servers/541672f9-79e5-466b-a3ac-ca41ebba8a0f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:36:49.325945 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-9d510015-ca47-4208-9a4e-a29da53d2fdb tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Action: 'create', calling method: .version_select at 0x7fa45ec2a940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1647000790", "metadata": {"Type": "work"}}} {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 09 10:36:49.644056 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-9d510015-ca47-4208-9a4e-a29da53d2fdb tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.443745 May 09 10:36:49.644958 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1772/3546] 10.222.0.26 () {60 vars in 1155 bytes} [Mon May 9 10:36:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 445 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 09 10:36:49.665956 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-03edc088-7e46-4496-87b6-7a75687ff86e tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Calling method '.version_select at 0x7fa45ed9a670>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:49.738521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-03edc088-7e46-4496-87b6-7a75687ff86e tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b" status: 200 len: 353 microversion: 2.1 time: 0.080264 May 09 10:36:49.739163 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1775/3547] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 10:36:49 2022] GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:36:50.752232 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-20ec5ec2-2556-4a7d-b807-c9483a352c12 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Calling method '.version_select at 0x7fa45efb9a60>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:50.802997 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-20ec5ec2-2556-4a7d-b807-c9483a352c12 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b" status: 200 len: 354 microversion: 2.1 time: 0.055499 May 09 10:36:50.803575 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1773/3548] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 10:36:50 2022] GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:36:50.819042 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-543d80a3-a990-4221-8b6f-c37c7c29a155 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Calling method '.version_select at 0x7fa45effa670>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:50.869695 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-543d80a3-a990-4221-8b6f-c37c7c29a155 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b" status: 200 len: 354 microversion: 2.1 time: 0.055197 May 09 10:36:50.870384 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1776/3549] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 10:36:50 2022] GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:36:50.887716 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-3780cd82-7d23-47b7-9ec1-7f80c9b86c21 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Calling method '.version_select at 0x7fa45ec2a700>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:50.953650 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-3780cd82-7d23-47b7-9ec1-7f80c9b86c21 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b" status: 202 len: 0 microversion: 2.1 time: 0.069894 May 09 10:36:50.954342 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1774/3550] 10.222.0.26 () {58 vars in 1247 bytes} [Mon May 9 10:36:50 2022] DELETE /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 09 10:36:50.963521 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: DEBUG nova.api.openstack.wsgi [None req-4c267ab5-c855-4f2f-ba66-89f8de6ea640 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Calling method '.version_select at 0x7fa467fe3dc0>' {{(pid=123637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:51.038236 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO nova.api.openstack.requestlog [None req-4c267ab5-c855-4f2f-ba66-89f8de6ea640 tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b" status: 200 len: 353 microversion: 2.1 time: 0.078790 May 09 10:36:51.038883 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: [pid: 123637|app: 0|req: 1777/3551] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 10:36:50 2022] GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 09 10:36:52.052819 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72ae38a7-1214-4063-b58e-5a0163d4411a tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Calling method '.version_select at 0x7fa45ec380d0>' {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 09 10:36:52.082991 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.wsgi [None req-72ae38a7-1214-4063-b58e-5a0163d4411a tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] HTTP exception thrown: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72ae38a7-1214-4063-b58e-5a0163d4411a tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Request method failure captured: May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: request: GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b HTTP/1.1 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept: application/json May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Accept-Encoding: identity May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Connection: close May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Length: 0 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Content-Type: application/json May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Host: 10.222.0.26 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Openstack-System-Scope: None May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: User-Agent: python-urllib3/1.26.9 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Auth-Token: gAAAAABieO7B0nJbjgMa-L6tAYu_FLkm7qVRgEXNn-pb_E62mfhiiJa-90E3mUvc3p77qLtrNWU-9wDqt3egyjTLQw3gJmKmSdSJYJbIf13yVy2QYURAOSKWh67tpkQsjXFV0tip0Wv8Pb74LcA46hxAZZOmIhg28aNYZDMLReLfJbg11O_FSG8 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Id: None May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Domain-Name: None May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Identity-Status: Confirmed May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Is-Admin-Project: True May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Id: default May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Domain-Name: Default May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Id: 67eabc70db904ec6b642b32c115cc885 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Project-Name: tempest-VolumesGetTestJSON-1820180336 May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Role: member,reader May 09 10:36:52.086015 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Roles: member,reader May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/67eabc70db904ec6b642b32c115cc885"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/67eabc70db904ec6b642b32c115cc885"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/67eabc70db904ec6b642b32c115cc885"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_67eabc70db904ec6b642b32c115cc885", "adminURL": "http://10.222.0.26:8080"}]}] May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant: tempest-VolumesGetTestJSON-1820180336 May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Id: 67eabc70db904ec6b642b32c115cc885 May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-Tenant-Name: tempest-VolumesGetTestJSON-1820180336 May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User: tempest-VolumesGetTestJSON-1820180336-project May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Id: default May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Domain-Name: Default May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Id: 41a56eb9859945b49652a7b78b2a2e2d May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: X-User-Name: tempest-VolumesGetTestJSON-1820180336-project May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: method: May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: exception: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: action_args: {'id': '8086ef77-9623-4d84-8089-a86a52b1301b'} May 09 10:36:52.088402 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: {{(pid=123638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. (HTTP 404) (Request-ID: req-09fc36b5-93d5-4c4d-822b-dda131cf3e68) May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:52.089883 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 09 10:36:52.091270 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 09 10:36:52.093048 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: ERROR nova.api.openstack.wsgi May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: DEBUG nova.api.openstack.wsgi [None req-72ae38a7-1214-4063-b58e-5a0163d4411a tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] Returning 404 to user: Volume 8086ef77-9623-4d84-8089-a86a52b1301b could not be found. {{(pid=123638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO nova.api.openstack.requestlog [None req-72ae38a7-1214-4063-b58e-5a0163d4411a tempest-VolumesGetTestJSON-1820180336 tempest-VolumesGetTestJSON-1820180336-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b" status: 404 len: 109 microversion: 2.1 time: 0.040258 May 09 10:36:52.094939 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: [pid: 123638|app: 0|req: 1775/3552] 10.222.0.26 () {58 vars in 1244 bytes} [Mon May 9 10:36:52 2022] GET /compute/v2.1/os-volumes/8086ef77-9623-4d84-8089-a86a52b1301b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 09 10:37:31.985774 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:37:31.986708 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:37:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:38:19.319885 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:38:19.320850 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:38:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:39:00.491987 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:39:00.492763 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:39:20.237321 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:39:20.238218 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:39:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:39:38.857750 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:39:38.858398 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:39:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:40:51.995287 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:40:51.996229 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:40:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:41:39.330294 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:41:39.331143 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:42:20.501810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:42:20.501810 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:42:25.109230 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:42:25.110010 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:42:40.248831 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:42:40.249585 dv-cinder-841083-1-iscsi devstack@n-api.service[123638]: Mon May 9 10:42:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 09 10:42:58.868228 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 09 10:42:58.870248 dv-cinder-841083-1-iscsi devstack@n-api.service[123637]: Mon May 9 10:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!